-- Logs begin at Thu 2022-06-16 13:56:39 UTC, end at Thu 2022-06-16 15:21:14 UTC. -- Jun 16 14:46:42.251472 dv-cinder-837163-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 14:46:42.261230 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 14:46:42.263228 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 14:46:42 2022] *** Jun 16 14:46:42.263228 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 14:46:42.263228 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 14:46:42.263228 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: nodename: dv-cinder-837163-3-iscsi Jun 16 14:46:42.263228 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: machine: x86_64 Jun 16 14:46:42.263228 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: clock source: unix Jun 16 14:46:42.263228 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: pcre jit disabled Jun 16 14:46:42.263228 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: detected number of CPU cores: 4 Jun 16 14:46:42.263228 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: current working directory: / Jun 16 14:46:42.263228 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: detected binary path: /usr/bin/uwsgi-core Jun 16 14:46:42.263976 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: your processes number limit is 47680 Jun 16 14:46:42.263976 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: your memory page size is 4096 bytes Jun 16 14:46:42.263976 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: detected max file descriptor number: 2048 Jun 16 14:46:42.263976 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: lock engine: pthread robust mutexes Jun 16 14:46:42.263976 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: thunder lock: enabled Jun 16 14:46:42.263976 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 14:46:42.263976 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 14:46:42.308662 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: Python main interpreter initialized at 0x556da74ae9c0 Jun 16 14:46:42.308662 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: python threads support enabled Jun 16 14:46:42.308662 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: your server socket listen backlog is limited to 100 connections Jun 16 14:46:42.308662 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: your mercy for graceful operations on workers is 90 seconds Jun 16 14:46:42.309110 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 14:46:42.309110 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: *** Operational MODE: preforking *** Jun 16 14:46:42.309356 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: *** uWSGI is running in multiple interpreter mode *** Jun 16 14:46:42.309356 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: spawned uWSGI master process (pid: 103056) Jun 16 14:46:42.309569 dv-cinder-837163-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 14:46:42.310134 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: spawned uWSGI worker 1 (pid: 103057, cores: 1) Jun 16 14:46:42.310458 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: spawned uWSGI worker 2 (pid: 103058, cores: 1) Jun 16 14:46:42.310645 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 14:46:42.985911 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 14:46:42.986493 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 14:46:44.208913 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:46:44.208913 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: from cryptography.utils import int_from_bytes Jun 16 14:46:44.209521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:46:44.209521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: from cryptography.utils import int_from_bytes Jun 16 14:46:44.775065 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:46:44.775065 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: from cryptography.utils import int_from_bytes Jun 16 14:46:44.775763 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:46:44.775763 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: from cryptography.utils import int_from_bytes Jun 16 14:46:47.415798 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 14:46:47.416510 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 14:46:47.416618 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 14:46:47.416944 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 14:46:47.417197 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 14:46:47.417587 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.417912 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.418236 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.418550 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.418882 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.419202 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.419517 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.419901 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.420201 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.420451 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.420852 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.421098 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837163-3-iscsi {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.421421 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.421730 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.422038 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.422385 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.422823 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.423192 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.423574 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.424361 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.424812 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.425172 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.425487 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.425830 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.426151 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.426459 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.426938 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.427163 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.427490 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.427825 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.428232 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837163-3-iscsi {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.428552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.428864 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.429184 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.429595 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.429908 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.430235 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.431145 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.431145 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.431383 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.431703 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.432034 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.432471 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.432760 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.432999 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.433312 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.433632 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.434071 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.434524 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.434969 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.435363 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.435666 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.436013 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.436342 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.436674 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.436930 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.437186 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.437505 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.437828 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.438138 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.438451 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.438833 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.439088 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.439447 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.439668 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.439997 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.440306 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.440623 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.440939 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.441268 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.441558 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.442071 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.443023 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.443278 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.443589 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.443964 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.444290 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.444601 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.444919 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.445240 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.445548 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.445856 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.446162 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.446480 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.446816 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.447120 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.447376 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.447713 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.448007 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.448326 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.448633 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.448940 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.449245 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.449548 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.449853 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.450162 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.450477 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.450785 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.451090 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.451395 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.451786 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.452108 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.452416 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.452739 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.453059 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.453369 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.453969 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.453969 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.454278 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.454607 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.454938 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.455192 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.455527 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.455867 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.456175 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.456495 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.456804 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.457115 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.457440 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.457816 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.458623 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.458943 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.459252 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.459562 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.459895 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.460201 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.460511 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.460872 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.461118 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.461421 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.461723 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.462047 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.462903 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.462903 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.463203 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.463366 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.463626 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.464002 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.464338 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.464686 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.465113 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.465453 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.466141 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.466141 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.466433 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.466724 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.467052 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.467374 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.467723 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.468057 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.468381 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.468704 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.469037 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.469356 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.469675 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.470093 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.470411 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.470734 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.471074 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.471407 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.471771 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.472132 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.472486 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.472803 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.473129 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.473482 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.473803 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.474118 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.474433 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.474757 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.475182 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.475410 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.475758 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.476200 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.476407 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.476727 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.477041 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.477728 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.477728 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.478013 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.478307 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.478462 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 14:46:47.478951 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.479103 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 14:46:47.479249 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.479249 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.479770 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.479946 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 14:46:47.480093 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.480237 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 14:46:47.480400 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.480543 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 14:46:47.480712 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.481024 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.481173 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.481337 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.481487 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.481632 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.481908 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.482092 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.482305 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.482447 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.482629 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.482786 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.482970 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.483193 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.483336 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.483578 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.483758 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.483914 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.484095 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.484258 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.484529 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.484677 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.484844 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.485000 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.485159 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.485333 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.485610 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.485858 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837163-3-iscsi {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.486079 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.486248 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.486416 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.486556 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.486777 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.486926 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.487136 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.487289 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.487493 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.487859 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.488018 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.488176 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.488428 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.488572 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.488793 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.488942 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.489146 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.489304 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.489450 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.489752 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.489980 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.490153 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.490420 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.490579 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.490796 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.490953 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.491110 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.491252 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.491439 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.491743 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.491894 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.492109 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.492263 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.492409 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.492603 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.492816 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.493048 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.493275 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.493459 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.493651 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.493814 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.493967 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.494179 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.494383 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.494588 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.494813 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.494995 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.495137 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837163-3-iscsi {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.495279 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.495491 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.495734 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.495890 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.496033 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.496189 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.496456 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.496628 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.496781 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.497059 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.497223 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.497415 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.497666 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.497823 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.498061 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.498202 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.498477 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.498626 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.498774 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.498987 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.499138 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.499340 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.499481 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.499659 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.499871 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.500019 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.500305 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.500484 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.500623 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.500758 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.500919 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.501181 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.501350 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.501545 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.501695 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.501868 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.502023 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.502169 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.502443 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.502646 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.503009 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.503236 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.503410 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.503568 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.503749 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.503903 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.504048 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.504191 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.504431 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.504585 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.505276 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.505567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.505783 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.505928 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.506083 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.506221 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.506466 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.506610 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.506812 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.506968 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.507117 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.507269 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.507419 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.507591 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.507845 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.508072 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.508231 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.508473 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.508711 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.508854 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.508996 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.509141 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.509373 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.509516 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.509712 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.509861 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.510020 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.510228 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.510373 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.510666 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.510823 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.511105 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.511249 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.511439 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.511654 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.511908 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.512116 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.512313 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.512494 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.512645 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.512785 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.513049 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.513236 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.513572 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.513824 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.514002 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.514157 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.514324 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.514603 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.514813 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.515168 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.515336 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.515501 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.515789 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.515981 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.516134 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.516411 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.516555 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.516778 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.516940 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.517080 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.517317 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.517462 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.517644 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.517793 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.517974 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.518203 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.518355 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.518604 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.518850 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.518993 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.519135 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.519277 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.519479 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.519636 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.519856 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.520098 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.520308 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.521061 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.521286 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.521439 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.521575 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.521719 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.521928 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.522073 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.522264 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.522435 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.522584 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.522883 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.523025 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.523209 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.523498 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.523646 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.523865 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.524021 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.524166 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.524453 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.524595 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.524778 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.524984 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.525127 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.525394 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.525543 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.525707 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.526024 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.526176 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.526337 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.526525 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.526673 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.526949 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.527101 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.527259 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.527485 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.527643 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.528160 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.528368 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.528522 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.528767 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.528998 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.529154 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.529303 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.529655 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.529812 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.529991 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.530134 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.530312 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.530518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.530661 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.530938 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.531080 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.531258 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.531416 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.531571 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.531831 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.531977 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.532270 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.532430 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.532654 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.532812 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.532949 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.533138 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.533295 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.533465 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.533608 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.533779 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.533986 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.534129 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.534386 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.534598 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.534815 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.535027 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.535198 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.535351 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.535496 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.535632 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.535889 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.536096 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.536244 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.536535 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.536679 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.536842 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.537059 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.537203 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.537450 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.537593 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.537774 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.537916 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.538084 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.538340 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.538484 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.538739 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.538891 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.539124 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.539277 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.539439 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.539639 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.539834 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.540098 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.540243 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.540427 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.540571 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.541019 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.541177 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.541324 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.541470 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.541615 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.541783 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.541926 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.542093 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.542237 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.542402 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.542633 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.542798 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.543010 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.543212 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.543420 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.543790 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.543959 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.544104 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.544239 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.544576 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.544718 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.544973 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.545118 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.545293 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.545606 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.545747 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:46:47.545924 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.546237 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.546430 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.546578 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.546749 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.546900 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.547155 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.547315 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.547453 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.547791 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.547945 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.548096 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.548399 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.548543 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.548711 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.548926 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.549071 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.549319 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.549461 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.549597 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.549818 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.549963 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.550197 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.550347 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.550491 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.550711 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.550856 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.551095 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.551238 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.551421 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.551607 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.551814 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.552070 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.552216 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.552377 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.552533 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.552671 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.552962 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.553104 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.553269 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.553432 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.553570 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.553861 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.554005 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.554192 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.554397 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.554636 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.554853 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.555056 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.555261 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.555405 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.555541 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.555739 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.555926 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.556067 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.556312 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.556535 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.556687 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.556902 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.557045 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.557187 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.557501 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.557653 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.557825 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.558006 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.558157 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.558424 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.558567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.558728 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.559030 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.559173 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.559403 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.559704 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.559865 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.560064 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.560225 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.560363 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.560603 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.560757 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.560983 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.561135 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.561281 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.561472 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.561615 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.561900 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.562054 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.562200 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.562379 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.562524 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.562810 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.562952 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.563122 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.563274 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.563411 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.563746 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.563909 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.564080 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.564291 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.564520 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.564713 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.564855 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.564991 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.565135 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.565310 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.565583 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.565797 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.566002 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.566206 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.566382 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.566568 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.566708 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.566900 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.567050 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.567763 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.568104 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.568278 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.568432 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.568723 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.568881 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.569050 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.569205 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.569357 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.569621 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.569782 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.569959 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.570110 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.570272 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.570489 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.570639 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.570876 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.571031 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.571204 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.571356 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.571507 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.571799 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.571966 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.572229 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.572387 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.572539 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.572682 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.572823 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.573127 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.573289 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.573567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.573730 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.573942 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.574145 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.574306 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.574533 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.574777 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.574777 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.575082 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.575226 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.575376 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.575519 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.575671 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.575911 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.576070 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.576433 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.576588 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.576767 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.577029 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.577184 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.577561 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.577712 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.577862 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.578242 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.578532 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.578791 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.579028 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.579258 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.579486 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.579486 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.580156 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.580385 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.580627 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.580865 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.580865 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.581325 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.581567 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.581820 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.582059 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.582284 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.582508 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.582508 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.583037 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.583270 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.583507 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.583766 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.584003 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.584258 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.584258 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.584704 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.584952 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.585191 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.585417 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.585417 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.585876 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.586104 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.586332 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.586555 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.586555 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.587006 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.587233 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.587233 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.587660 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.587992 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.587992 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.588460 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.588686 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.588912 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.589141 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.589141 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.589603 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.589865 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.590203 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.590436 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.590672 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.590920 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.591163 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.591402 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.591402 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.591934 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.592185 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.592441 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.592670 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.592670 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.593115 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.593343 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.593569 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.593802 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.594044 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.594271 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.594271 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.594697 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.594924 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.595172 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.595399 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.595399 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.595878 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.596132 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.596361 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.596603 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.596830 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.597070 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.597294 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.597530 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.597766 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.598011 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.598011 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.598462 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.598702 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.598951 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.599212 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.599212 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.599646 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.599928 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.599928 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.600536 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.600784 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.600784 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.601213 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.601440 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.601440 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.601869 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.602114 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.602357 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.602585 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.602585 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.603016 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.603252 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.603490 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.603744 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.603744 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.604175 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.604415 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.604415 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.604860 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.605088 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.605088 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.605526 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.605763 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.606025 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.606260 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.606260 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.606709 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.606946 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.607172 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.607506 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.607506 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.607981 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.608210 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.608457 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.608682 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.608682 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.609140 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.609365 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.609599 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.609826 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.609826 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.610276 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.610528 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.610894 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.611130 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.611353 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.611597 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.611597 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.612102 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.612345 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.612568 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.612794 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.613031 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.613269 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.613269 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.613721 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.613947 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.614729 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.614976 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.614976 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.615421 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.615648 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.615922 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.616166 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.616166 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.616608 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.616945 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.616945 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.617411 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.617652 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.617652 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.618081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.618314 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.618544 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.618786 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.618786 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.619229 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.619458 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.619458 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.619914 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.620187 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.620435 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.620666 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.620666 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.621226 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.621461 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.621708 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.621951 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.622179 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.622405 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.622633 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.622860 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.622860 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.623313 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.623542 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.623817 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.624051 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.624051 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.624507 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.624735 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.624981 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.625208 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.625208 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.625643 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.625887 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.626129 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.626356 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.626582 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.626820 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.626820 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.627274 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.627509 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.627888 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.628124 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.628124 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.628589 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.628818 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.629044 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.629273 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.629273 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.629725 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.630020 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.630020 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.630475 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.630730 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.630973 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.631250 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.631250 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.632035 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.632271 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.632271 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.632703 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.632960 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.633190 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.633415 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.633652 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.633877 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.634128 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.634367 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.634593 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.634593 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.635021 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.635246 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.635493 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.635834 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.636066 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.636295 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.636539 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.636774 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.636774 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.637238 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.637463 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.637700 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.637929 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.638154 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.638403 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.638403 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.638841 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.639075 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.639298 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.639298 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.639836 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.640082 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.640308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.640544 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.640773 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.641020 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.641020 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.641456 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.641705 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.642085 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.642327 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.642327 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.642777 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.643005 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.643005 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.643463 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.643734 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.643734 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.644192 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.644416 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.644416 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.644848 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.645083 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.645845 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.646086 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.646310 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.646576 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.646804 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.647041 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.647267 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.647494 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.647746 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.647979 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.647979 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.648436 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.648678 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.648916 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.649142 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.649367 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.649606 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.649855 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.650082 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.650082 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.650524 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.650750 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.650989 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.651215 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.651215 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.651639 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.651896 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.652243 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.652594 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.653087 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.653770 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.653999 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.653999 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.654442 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.654668 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.654668 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.654668 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.655300 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.655542 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.655542 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.656111 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.656358 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.656358 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.656784 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.657010 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.657238 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.657484 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.657484 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.657911 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.658136 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.658136 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.658576 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.658838 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.658838 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.659269 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.659504 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.659751 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.659995 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.659995 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.660445 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.660688 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.660959 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.661358 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.661358 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.661816 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.662063 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.662494 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.662730 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.662961 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.663210 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.663210 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.663667 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.663924 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.664153 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.664384 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.664613 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.664963 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.665192 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.665439 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.665669 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.665961 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.665961 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.666430 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.666660 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.666883 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.667109 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.667333 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.667572 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.667572 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.668631 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.668880 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.668880 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.669340 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.669586 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.669819 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.670046 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.670046 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.670477 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.670713 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.670713 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.671178 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.671406 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.671406 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.672675 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.672915 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.673166 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.673394 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.673394 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.674775 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.675023 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.675023 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.675451 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.675730 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.675963 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.676192 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.676192 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.677206 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.677456 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.677690 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.677919 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.677919 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.678369 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.678601 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.678828 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.679056 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.679056 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.679520 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.679816 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.680050 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.680294 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.680294 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.680741 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.680992 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.681222 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.681449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.681677 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.681908 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.682151 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.682394 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.682394 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.683015 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.683249 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.683479 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.683731 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.683731 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.684190 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.684430 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.684659 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.684888 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.685129 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.685356 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.685583 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.685823 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.686055 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.686283 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.686538 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.686768 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.687009 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.687242 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.687469 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.687727 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.687983 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.688218 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.688442 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.688669 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.688913 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.689152 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.689379 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.689616 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.689839 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.690066 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.690300 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.690548 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.690787 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.691011 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.691248 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.691475 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.691781 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.692040 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.692339 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.693223 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.693470 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.693698 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.693940 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.694180 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.694420 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.694648 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.694877 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.695107 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.695348 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.695584 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.695879 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.696112 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.696340 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.696564 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.696822 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.697056 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.697292 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.697521 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.697749 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.697978 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.698243 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.698481 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.698729 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.698980 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.699210 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.699439 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.699771 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.700023 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.700253 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.700482 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.700719 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.700719 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.701184 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.701424 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.701653 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.701914 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.702154 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.702397 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.702626 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.702855 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.703080 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.703539 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.703826 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.704078 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.704308 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.704548 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.704777 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.705004 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.705268 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.705509 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.705736 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.705962 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.706189 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.706428 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.706668 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.706909 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.707147 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.707393 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.707624 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.708000 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.708210 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.708430 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.708660 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.708913 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.709111 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.709313 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.709559 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.709799 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.710029 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.710258 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.710486 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.710717 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.710961 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.711222 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.711454 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.711724 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.711960 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.712316 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.712549 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.712778 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.713005 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.713233 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.713485 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.713905 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.714140 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.714366 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.714624 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.714907 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.715148 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.715388 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.715614 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.715869 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.716111 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.716351 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.716579 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.716820 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.717142 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.717387 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.717631 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.717872 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.718111 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.718338 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.718566 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.718804 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.719043 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.719269 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.719525 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.719801 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.720050 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.720323 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.720551 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.720793 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.720793 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.721244 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.721468 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.721468 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.721908 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.722150 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.722396 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.722621 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.722847 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.723084 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.723327 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.723607 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.723905 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.724281 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.724517 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.724759 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.724986 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.725226 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.725464 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 14:46:47.725694 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.725694 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.725694 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.725694 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.725694 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.725694 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.725694 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.725694 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.727427 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.727427 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.727427 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.727427 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.727427 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.727427 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.727427 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.727427 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.729169 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.729169 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.729169 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.729169 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.729169 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.729169 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.729169 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.729169 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.730904 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.730904 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.730904 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.730904 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.730904 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.730904 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.730904 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.730904 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.732658 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.732658 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.732658 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.732658 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.732658 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.732658 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.732658 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.732658 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.734522 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.734522 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.734522 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.734522 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.734522 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.734522 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.734522 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.734522 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.736356 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.736356 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.736356 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.736356 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.736356 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.736356 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.736356 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.736356 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.738043 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.738043 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.738043 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.738043 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.738043 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.738043 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.738043 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.738043 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.740114 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.740114 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.740114 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.740114 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.740114 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.740114 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.740114 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.740114 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.741144 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.741144 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.741144 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.741144 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.741144 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.741144 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.741144 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.741144 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.742188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.742188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.742188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.742188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.742188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.742188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.742188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.742188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.743159 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.743159 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.743159 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.743159 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.743159 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.743159 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.743159 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.743159 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.744392 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.744392 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.744392 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.744392 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.744392 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.744392 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.744392 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.744392 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.745310 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.745310 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.745310 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.745310 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.745310 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.745310 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.745310 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.745310 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.746328 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.746328 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.746328 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.746328 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.746328 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.746328 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.746328 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.746328 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.747319 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.747319 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.747319 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.747319 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.747319 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.747319 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.747319 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.747319 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.748422 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.748422 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.748422 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.748422 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.748422 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.748422 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.748422 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.748422 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.749542 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.749542 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.749542 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.749542 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.749542 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.749542 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.749542 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.749542 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.750541 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.750541 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.750541 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.750541 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.750541 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.750541 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.750541 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.751946 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.751946 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.751946 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.751946 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.751946 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.751946 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.751946 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.751946 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.752944 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.752944 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.752944 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.752944 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.752944 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.752944 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.752944 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.752944 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.753940 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.753940 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.753940 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.753940 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.753940 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.753940 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.753940 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.753940 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.755492 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.755492 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.755492 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.755492 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.755492 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.755492 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.755492 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.755492 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.756551 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.756551 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.756551 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.756551 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.756551 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.756551 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.756551 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.756551 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.757565 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.757565 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.757565 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.757565 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.757565 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.757565 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.757565 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.757565 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.758466 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.758466 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.758466 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.758702 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO dbcounter [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] Registered counter for database nova_api Jun 16 14:46:47.758843 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.758843 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.758843 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.758843 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.758843 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.758843 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.758843 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.758843 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.759919 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.759919 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.759919 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.759919 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.759919 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.759919 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.759919 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.760760 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.760760 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.760760 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.761449 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.761449 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.761740 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.761876 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.762145 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.762469 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.762785 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.763117 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.763436 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.763781 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.764143 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.764464 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.765022 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.765360 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.765684 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.766022 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.766358 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.766668 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.766982 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.768006 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.768006 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.768579 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.769159 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.776237 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.776743 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.777360 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.778229 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.778832 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.779441 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.779761 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_db.sqlalchemy.engines [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103057) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:46:47.779909 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.780328 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.780949 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.781357 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.781970 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.782589 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.783259 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.783915 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.784528 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.785149 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.785735 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.786373 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.786976 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.787572 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.787769 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG dbcounter [-] [103057] Writer thread running {{(pid=103057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:46:47.788170 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.788754 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.789363 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.789949 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.790515 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.791312 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.792004 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.792500 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.793085 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.793666 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.794256 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.794845 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.795415 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.796041 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.796617 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.797212 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.797832 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.798443 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.799033 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.799592 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.800187 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.800746 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.801324 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.802284 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.802714 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.803203 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.803607 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.804018 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.804276 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.804770 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.805338 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.805929 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.806498 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.807195 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.807585 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.808146 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.808701 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.809256 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.809834 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.810396 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.810950 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.811500 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.812076 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.812630 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.813176 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.813787 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.814394 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.814964 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.815546 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.816146 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.816728 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.817347 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.818421 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.819360 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.819360 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.819896 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.820444 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.820842 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.821388 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.821773 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.822192 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.822620 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.823017 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.823383 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.823965 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.824508 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.825084 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.825649 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.826197 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.826759 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.827345 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.827939 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.828503 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.829055 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.829624 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.830180 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.830742 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.831305 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.831897 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.832481 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.833083 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.833611 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.834186 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.834759 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.835385 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.835968 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.836560 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.837136 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.837699 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.838273 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.838814 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:46:47.839235 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 14:46:47.849159 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.context [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),58914df1-3604-4005-8544-4e2578c5de60(cell1) {{(pid=103057) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 14:46:47.853913 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:47.855516 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:47.856327 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:47.858327 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:47.860367 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO dbcounter [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] Registered counter for database nova_cell0 Jun 16 14:46:47.864920 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO dbcounter [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] Registered counter for database nova_cell1 Jun 16 14:46:47.872804 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_db.sqlalchemy.engines [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103057) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:46:47.874664 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_db.sqlalchemy.engines [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103057) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:46:47.881381 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG dbcounter [-] [103057] Writer thread running {{(pid=103057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:46:47.882630 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG dbcounter [-] [103057] Writer thread running {{(pid=103057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:46:47.924735 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO dbcounter [None req-2f6d62b6-298e-4864-914a-c869251ab9d0 None None] Registered counter for database nova_api Jun 16 14:46:47.946902 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG oslo_db.sqlalchemy.engines [None req-2f6d62b6-298e-4864-914a-c869251ab9d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:46:47.955860 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG dbcounter [-] [103058] Writer thread running {{(pid=103058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:46:48.016678 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.context [None req-2f6d62b6-298e-4864-914a-c869251ab9d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),58914df1-3604-4005-8544-4e2578c5de60(cell1) {{(pid=103058) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 14:46:48.022621 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG oslo_concurrency.lockutils [None req-2f6d62b6-298e-4864-914a-c869251ab9d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:48.025085 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG oslo_concurrency.lockutils [None req-2f6d62b6-298e-4864-914a-c869251ab9d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:48.026335 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG oslo_concurrency.lockutils [None req-2f6d62b6-298e-4864-914a-c869251ab9d0 None None] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:48.029755 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG oslo_concurrency.lockutils [None req-2f6d62b6-298e-4864-914a-c869251ab9d0 None None] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:48.033126 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO dbcounter [None req-2f6d62b6-298e-4864-914a-c869251ab9d0 None None] Registered counter for database nova_cell0 Jun 16 14:46:48.037436 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO dbcounter [None req-2f6d62b6-298e-4864-914a-c869251ab9d0 None None] Registered counter for database nova_cell1 Jun 16 14:46:48.038662 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO dbcounter [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] Registered counter for database nova_cell0 Jun 16 14:46:48.050571 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG oslo_db.sqlalchemy.engines [None req-2f6d62b6-298e-4864-914a-c869251ab9d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:46:48.052380 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG oslo_db.sqlalchemy.engines [None req-2f6d62b6-298e-4864-914a-c869251ab9d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:46:48.057172 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_db.sqlalchemy.engines [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103057) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:46:48.063034 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG dbcounter [-] [103057] Writer thread running {{(pid=103057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:46:48.066058 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG dbcounter [-] [103058] Writer thread running {{(pid=103058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:46:48.066399 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG dbcounter [-] [103058] Writer thread running {{(pid=103058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:46:48.242288 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO dbcounter [None req-2f6d62b6-298e-4864-914a-c869251ab9d0 None None] Registered counter for database nova_cell0 Jun 16 14:46:48.253975 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG oslo_db.sqlalchemy.engines [None req-2f6d62b6-298e-4864-914a-c869251ab9d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:46:48.259569 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG dbcounter [-] [103058] Writer thread running {{(pid=103058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:46:48.422481 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: WARNING keystonemiddleware.auth_token [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:46:48.430504 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: WARNING keystonemiddleware.auth_token [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:46:48.600977 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: WARNING keystonemiddleware.auth_token [None req-2f6d62b6-298e-4864-914a-c869251ab9d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:46:48.609528 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: WARNING keystonemiddleware.auth_token [None req-2f6d62b6-298e-4864-914a-c869251ab9d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:46:48.778773 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: WARNING keystonemiddleware.auth_token [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:46:48.785205 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: WARNING keystonemiddleware.auth_token [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:46:48.791365 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556da74ae9c0 pid: 103057 (default app) Jun 16 14:46:48.793676 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:48.794987 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] 10.222.0.76 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001967 Jun 16 14:46:48.795639 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 788 bytes} [Thu Jun 16 14:46:48 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:46:48.962275 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: WARNING keystonemiddleware.auth_token [None req-2f6d62b6-298e-4864-914a-c869251ab9d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:46:48.968425 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: WARNING keystonemiddleware.auth_token [None req-2f6d62b6-298e-4864-914a-c869251ab9d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:46:48.974373 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556da74ae9c0 pid: 103058 (default app) Jun 16 14:48:15.229099 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:15.230112 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 16 14:48:15.236861 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 2/2] 10.222.0.76 () {54 vars in 930 bytes} [Thu Jun 16 14:48:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:15.246024 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG dbcounter [-] [103058] Writing DB stats nova_api:SELECT=3 {{(pid=103058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:15.249828 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG dbcounter [-] [103058] Writing DB stats nova_cell0:SELECT=3 {{(pid=103058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:15.251774 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG dbcounter [-] [103058] Writing DB stats nova_cell1:SELECT=3 {{(pid=103058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:15.254923 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG dbcounter [-] [103058] Writing DB stats nova_cell0:SELECT=3 {{(pid=103058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:16.010075 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-0a10bf40-098c-4df5-bd88-8bf1e0ced04b admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:16.068088 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-0a10bf40-098c-4df5-bd88-8bf1e0ced04b admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.827753 Jun 16 14:48:16.070552 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 1/3] 10.222.0.76 () {60 vars in 1291 bytes} [Thu Jun 16 14:48:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:48:19.121749 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:19.123868 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-4ddbfe09-0f24-4615-b333-97f5dbb50c3c None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002702 Jun 16 14:48:19.124950 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 3/4] 10.222.0.76 () {54 vars in 930 bytes} [Thu Jun 16 14:48:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:19.204247 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-a0f0a6b9-f00f-4cba-868f-deece28994db admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:19.226607 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:48:19.226607 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: warnings.warn(msg) Jun 16 14:48:19.276451 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-a0f0a6b9-f00f-4cba-868f-deece28994db admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.140325 Jun 16 14:48:19.276849 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 2/5] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Jun 16 14:48:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:48:19.302122 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG dbcounter [-] [103057] Writing DB stats nova_api:SELECT=3 {{(pid=103057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:19.302961 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG dbcounter [-] [103057] Writing DB stats nova_cell0:SELECT=3 {{(pid=103057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:19.303739 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG dbcounter [-] [103057] Writing DB stats nova_cell1:SELECT=3 {{(pid=103057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:19.306575 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG dbcounter [-] [103057] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:19.546594 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-d8d8d603-950b-4151-b707-722c614c5ff1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:19.549133 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:48:19.549133 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: warnings.warn(msg) Jun 16 14:48:19.614657 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-d8d8d603-950b-4151-b707-722c614c5ff1 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.325163 Jun 16 14:48:19.615501 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 4/6] 10.222.0.76 () {64 vars in 1335 bytes} [Thu Jun 16 14:48:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:22.683489 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-a0f0a6b9-f00f-4cba-868f-deece28994db admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:22.684561 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-a0f0a6b9-f00f-4cba-868f-deece28994db admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001721 Jun 16 14:48:22.684967 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 3/7] 10.222.0.76 () {54 vars in 930 bytes} [Thu Jun 16 14:48:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:48:22.864518 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-8b420394-43d0-4547-b565-4c6ce952fa3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "name": "ds512M", "vcpus": 1}} {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:22.886189 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:48:22.886189 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: warnings.warn(msg) Jun 16 14:48:22.919629 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-8b420394-43d0-4547-b565-4c6ce952fa3b admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.221857 Jun 16 14:48:22.927398 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 5/8] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Jun 16 14:48:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:48:22.940241 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-76d8e1bd-8781-4939-8a09-944f883a9c40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:22.943046 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:48:22.943046 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: warnings.warn(msg) Jun 16 14:48:22.999771 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-76d8e1bd-8781-4939-8a09-944f883a9c40 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067319 Jun 16 14:48:23.012280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 4/9] 10.222.0.76 () {64 vars in 1335 bytes} [Thu Jun 16 14:48:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:26.293801 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-8b420394-43d0-4547-b565-4c6ce952fa3b admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:26.295026 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-8b420394-43d0-4547-b565-4c6ce952fa3b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001772 Jun 16 14:48:26.296150 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 6/10] 10.222.0.76 () {54 vars in 930 bytes} [Thu Jun 16 14:48:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:26.384175 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-ee76afda-24f6-4385-803e-48f23ea6f624 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "vcpus": 1, "name": "ds1G", "swap": 0, "ram": 1024}} {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:26.433680 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-ee76afda-24f6-4385-803e-48f23ea6f624 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.130304 Jun 16 14:48:26.436227 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 5/11] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Jun 16 14:48:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:48:26.450916 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-946afe91-9e87-4641-984e-49d2d77e1c57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:26.488080 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-946afe91-9e87-4641-984e-49d2d77e1c57 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042393 Jun 16 14:48:26.489852 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 7/12] 10.222.0.76 () {64 vars in 1335 bytes} [Thu Jun 16 14:48:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:29.216632 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-ee76afda-24f6-4385-803e-48f23ea6f624 admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:29.218347 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-ee76afda-24f6-4385-803e-48f23ea6f624 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002450 Jun 16 14:48:29.219051 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 6/13] 10.222.0.76 () {54 vars in 930 bytes} [Thu Jun 16 14:48:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:29.293279 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-21a52d53-5968-4e81-9e7a-a93dafac39ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "name": "ds2G", "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:29.314845 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-21a52d53-5968-4e81-9e7a-a93dafac39ee admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.086952 Jun 16 14:48:29.315444 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 8/14] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Jun 16 14:48:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:48:29.328165 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-46b76d2d-5fbf-46e0-aaa1-8af9ad932b13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:29.353435 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-46b76d2d-5fbf-46e0-aaa1-8af9ad932b13 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028816 Jun 16 14:48:29.354394 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 7/15] 10.222.0.76 () {64 vars in 1335 bytes} [Thu Jun 16 14:48:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:31.800392 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-21a52d53-5968-4e81-9e7a-a93dafac39ee admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:31.801407 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-21a52d53-5968-4e81-9e7a-a93dafac39ee admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002049 Jun 16 14:48:31.801815 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 9/16] 10.222.0.76 () {54 vars in 930 bytes} [Thu Jun 16 14:48:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:31.918382 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-17b501ca-ae3d-47db-9cd5-b06a428a084d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "ram": 4096, "swap": 0, "id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:31.946670 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-17b501ca-ae3d-47db-9cd5-b06a428a084d admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138087 Jun 16 14:48:31.948304 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 8/17] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Jun 16 14:48:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 14:48:31.961622 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-bdf22f93-5165-4916-866a-34eaa84c5f1b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:31.995477 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-bdf22f93-5165-4916-866a-34eaa84c5f1b admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038436 Jun 16 14:48:31.996364 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 10/18] 10.222.0.76 () {64 vars in 1335 bytes} [Thu Jun 16 14:48:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:34.484280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-17b501ca-ae3d-47db-9cd5-b06a428a084d admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:34.485374 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-17b501ca-ae3d-47db-9cd5-b06a428a084d admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Jun 16 14:48:34.486118 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 9/19] 10.222.0.76 () {54 vars in 930 bytes} [Thu Jun 16 14:48:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:34.572417 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-eb7bedef-8338-4952-8751-a4b0e6fe84b9 admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:34.600802 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-eb7bedef-8338-4952-8751-a4b0e6fe84b9 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.105350 Jun 16 14:48:34.601706 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 11/20] 10.222.0.76 () {60 vars in 1291 bytes} [Thu Jun 16 14:48:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:48:37.293206 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-17b501ca-ae3d-47db-9cd5-b06a428a084d admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:37.294522 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-17b501ca-ae3d-47db-9cd5-b06a428a084d admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001935 Jun 16 14:48:37.295007 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 10/21] 10.222.0.76 () {54 vars in 930 bytes} [Thu Jun 16 14:48:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:48:37.384937 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-bd66a8d1-113f-4339-9409-5ceeab417063 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 1, "id": "1", "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:37.408754 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-bd66a8d1-113f-4339-9409-5ceeab417063 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.102846 Jun 16 14:48:37.409801 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 12/22] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Jun 16 14:48:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:48:37.427408 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-20b16beb-455f-4080-bbbc-1272897a456c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:37.459797 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-20b16beb-455f-4080-bbbc-1272897a456c admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037930 Jun 16 14:48:37.460561 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 11/23] 10.222.0.76 () {64 vars in 1332 bytes} [Thu Jun 16 14:48:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:48:40.361427 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-bd66a8d1-113f-4339-9409-5ceeab417063 admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:40.363291 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-bd66a8d1-113f-4339-9409-5ceeab417063 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002367 Jun 16 14:48:40.363988 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 13/24] 10.222.0.76 () {54 vars in 930 bytes} [Thu Jun 16 14:48:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:48:40.469170 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-43ad52a2-e921-4d14-8ba7-e3f4e476da59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 20, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:40.503788 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-43ad52a2-e921-4d14-8ba7-e3f4e476da59 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.128312 Jun 16 14:48:40.504828 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 12/25] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Jun 16 14:48:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:48:40.521019 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-5d831b89-8988-4f9f-853b-5350d0eaca04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:40.555438 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-5d831b89-8988-4f9f-853b-5350d0eaca04 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038868 Jun 16 14:48:40.556197 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 14/26] 10.222.0.76 () {64 vars in 1332 bytes} [Thu Jun 16 14:48:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:48:42.897837 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-43ad52a2-e921-4d14-8ba7-e3f4e476da59 admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:42.898909 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-43ad52a2-e921-4d14-8ba7-e3f4e476da59 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Jun 16 14:48:42.899493 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 13/27] 10.222.0.76 () {54 vars in 930 bytes} [Thu Jun 16 14:48:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:42.978243 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-7ff436bf-f95d-49d4-8b14-178ade38406a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 4096, "id": "3", "disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:43.000075 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-7ff436bf-f95d-49d4-8b14-178ade38406a admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.093649 Jun 16 14:48:43.000962 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 15/28] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Jun 16 14:48:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 14:48:43.015552 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-123a15f0-4bc7-40c6-b8ae-7572c7eb295e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:43.044811 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-123a15f0-4bc7-40c6-b8ae-7572c7eb295e admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033737 Jun 16 14:48:43.045532 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 14/29] 10.222.0.76 () {64 vars in 1332 bytes} [Thu Jun 16 14:48:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:45.413848 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-7ff436bf-f95d-49d4-8b14-178ade38406a admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:45.415461 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-7ff436bf-f95d-49d4-8b14-178ade38406a admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Jun 16 14:48:45.416108 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 16/30] 10.222.0.76 () {54 vars in 930 bytes} [Thu Jun 16 14:48:45 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:45.518259 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-51e31529-3435-4a68-bdd4-203f7a09bdf9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "name": "m1.large", "rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true, "id": "4", "vcpus": 4, "swap": 0}} {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:45.530403 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG dbcounter [-] [103058] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:45.558468 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-51e31529-3435-4a68-bdd4-203f7a09bdf9 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.134717 Jun 16 14:48:45.559099 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 15/31] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Jun 16 14:48:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 14:48:45.572190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-ec8ea281-f950-41ef-8f79-332ec834b483 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:45.603015 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-ec8ea281-f950-41ef-8f79-332ec834b483 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035059 Jun 16 14:48:45.603727 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 17/32] 10.222.0.76 () {64 vars in 1332 bytes} [Thu Jun 16 14:48:45 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:48.173381 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-51e31529-3435-4a68-bdd4-203f7a09bdf9 admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:48.174511 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-51e31529-3435-4a68-bdd4-203f7a09bdf9 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001715 Jun 16 14:48:48.189959 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 16/33] 10.222.0.76 () {54 vars in 930 bytes} [Thu Jun 16 14:48:48 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:48.242523 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-c8dd9637-a5f6-45b1-b920-d3367022ab51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "disk": 160, "ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5"}} {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:48.261123 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-c8dd9637-a5f6-45b1-b920-d3367022ab51 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079644 Jun 16 14:48:48.261847 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 18/34] 10.222.0.76 () {64 vars in 1282 bytes} [Thu Jun 16 14:48:48 2022] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:48:48.274161 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-5254662f-62ea-451b-abf8-1162af6173e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:48.305385 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-5254662f-62ea-451b-abf8-1162af6173e3 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034438 Jun 16 14:48:48.306373 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 17/35] 10.222.0.76 () {64 vars in 1332 bytes} [Thu Jun 16 14:48:48 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:12.959085 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-c8dd9637-a5f6-45b1-b920-d3367022ab51 admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:12.960784 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-c8dd9637-a5f6-45b1-b920-d3367022ab51 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002377 Jun 16 14:49:12.961438 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 19/36] 10.222.0.76 () {54 vars in 930 bytes} [Thu Jun 16 14:49:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:12.975123 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG dbcounter [-] [103058] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:13.028823 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-b13adf5b-99ae-429f-b8c0-ba580a74c1cd admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:13.047476 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-b13adf5b-99ae-429f-b8c0-ba580a74c1cd admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.077343 Jun 16 14:49:13.048113 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 18/37] 10.222.0.76 () {60 vars in 1291 bytes} [Thu Jun 16 14:49:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:49:14.082872 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-c8dd9637-a5f6-45b1-b920-d3367022ab51 admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:14.083925 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-c8dd9637-a5f6-45b1-b920-d3367022ab51 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 16 14:49:14.084372 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 20/38] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Jun 16 14:49:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:14.281550 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-5c25ab9e-fdac-4c6c-9655-bf892c813dfe admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:14.288179 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.wsgi [None req-5c25ab9e-fdac-4c6c-9655-bf892c813dfe admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-5c25ab9e-fdac-4c6c-9655-bf892c813dfe admin admin] Request method failure captured: Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Accept: application/json Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Accept-Encoding: gzip, deflate Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Connection: keep-alive Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Content-Length: 0 Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Host: 10.222.0.76 Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Openstack-Api-Version: compute 2.90 Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Openstack-System-Scope: None Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: User-Agent: python-novaclient Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Auth-Token: gAAAAABiq0Lqq2f05cIysCxfLON8KTW1NfCDbFAgbEIM3Q0VzQo5mPX-3ZV0-llgQqsost_sQrNyxDALoRn4W8CrIC2of2oYTKGgCwcCyVcwrPMkKYjUc9UCVtQtDgB9DPCkfaorRGfUp2JqRY7PB8z2GJ9Cen5R0kRQRgq08MGMSgMHrhpzqOM Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Domain-Id: None Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Domain-Name: None Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Identity-Status: Confirmed Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Is-Admin-Project: True Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Project-Domain-Id: default Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Project-Domain-Name: Default Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Project-Id: cd241c469a14403da8a00ae7230e80b3 Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Project-Name: admin Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Role: member,admin,reader Jun 16 14:49:14.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Roles: member,admin,reader Jun 16 14:49:14.293101 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:49:14.293101 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Tenant: admin Jun 16 14:49:14.293101 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Tenant-Id: cd241c469a14403da8a00ae7230e80b3 Jun 16 14:49:14.293101 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Tenant-Name: admin Jun 16 14:49:14.293101 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-User: admin Jun 16 14:49:14.293101 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-User-Domain-Id: default Jun 16 14:49:14.293101 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-User-Domain-Name: Default Jun 16 14:49:14.293101 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-User-Id: b18c82c77c244d2f9aa2c245612ee1a2 Jun 16 14:49:14.293101 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-User-Name: admin Jun 16 14:49:14.293101 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: method: > Jun 16 14:49:14.293101 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: exception: Flavor 42 could not be found. Jun 16 14:49:14.293101 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: action_args: {'id': '42'} Jun 16 14:49:14.293101 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:14.293101 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:14.294081 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:14.295446 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:14.295446 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:14.295446 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:14.295446 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:14.295446 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 14:49:14.295446 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:14.295446 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 14:49:14.295446 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Jun 16 14:49:14.295446 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:14.295446 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Jun 16 14:49:14.295446 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:14.295446 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:14.295446 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:14.295446 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:14.295446 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:14.295446 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 14:49:14.295446 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Jun 16 14:49:14.295446 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-5c25ab9e-fdac-4c6c-9655-bf892c813dfe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:14.296688 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-5c25ab9e-fdac-4c6c-9655-bf892c813dfe admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.065564 Jun 16 14:49:14.296688 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 19/39] 10.222.0.76 () {60 vars in 1190 bytes} [Thu Jun 16 14:49:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:14.302668 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-831da314-eb2c-42ba-9683-69cc2819b74c admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:14.305661 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG dbcounter [-] [103057] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:14.325146 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-831da314-eb2c-42ba-9683-69cc2819b74c admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025982 Jun 16 14:49:14.325713 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 21/40] 10.222.0.76 () {60 vars in 1210 bytes} [Thu Jun 16 14:49:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:49:14.336087 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-699f7d29-5629-437f-8a4a-b16d3cc8acb0 admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:14.361570 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-699f7d29-5629-437f-8a4a-b16d3cc8acb0 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028889 Jun 16 14:49:14.362142 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 20/41] 10.222.0.76 () {60 vars in 1210 bytes} [Thu Jun 16 14:49:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:49:14.373002 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-94f9b835-dae1-4d7f-a978-7abd21de03a9 admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:14.379266 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.wsgi [None req-94f9b835-dae1-4d7f-a978-7abd21de03a9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-94f9b835-dae1-4d7f-a978-7abd21de03a9 admin admin] Request method failure captured: Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Accept: application/json Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Accept-Encoding: gzip, deflate Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Connection: keep-alive Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Content-Length: 0 Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Host: 10.222.0.76 Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Openstack-Api-Version: compute 2.90 Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Openstack-System-Scope: None Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: User-Agent: python-novaclient Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Auth-Token: gAAAAABiq0Lqq2f05cIysCxfLON8KTW1NfCDbFAgbEIM3Q0VzQo5mPX-3ZV0-llgQqsost_sQrNyxDALoRn4W8CrIC2of2oYTKGgCwcCyVcwrPMkKYjUc9UCVtQtDgB9DPCkfaorRGfUp2JqRY7PB8z2GJ9Cen5R0kRQRgq08MGMSgMHrhpzqOM Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Domain-Id: None Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Domain-Name: None Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Identity-Status: Confirmed Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Is-Admin-Project: True Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Project-Domain-Id: default Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Project-Domain-Name: Default Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Project-Id: cd241c469a14403da8a00ae7230e80b3 Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Project-Name: admin Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Role: member,admin,reader Jun 16 14:49:14.382552 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Roles: member,admin,reader Jun 16 14:49:14.384220 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:49:14.384220 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Tenant: admin Jun 16 14:49:14.384220 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Tenant-Id: cd241c469a14403da8a00ae7230e80b3 Jun 16 14:49:14.384220 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Tenant-Name: admin Jun 16 14:49:14.384220 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-User: admin Jun 16 14:49:14.384220 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-User-Domain-Id: default Jun 16 14:49:14.384220 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-User-Domain-Name: Default Jun 16 14:49:14.384220 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-User-Id: b18c82c77c244d2f9aa2c245612ee1a2 Jun 16 14:49:14.384220 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-User-Name: admin Jun 16 14:49:14.384220 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: method: > Jun 16 14:49:14.384220 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: exception: Flavor 42 could not be found. Jun 16 14:49:14.384220 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: action_args: {'id': '42'} Jun 16 14:49:14.384220 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:14.384220 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:14.385126 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:14.386190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:14.386190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:14.386190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:14.386190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:14.386190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 14:49:14.386190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:14.386190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 14:49:14.386190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Jun 16 14:49:14.386190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:14.386190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Jun 16 14:49:14.386190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:14.386190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:14.386190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:14.386190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:14.386190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:14.386190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 14:49:14.386190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Jun 16 14:49:14.386190 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-94f9b835-dae1-4d7f-a978-7abd21de03a9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103057) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:14.387151 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-94f9b835-dae1-4d7f-a978-7abd21de03a9 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015481 Jun 16 14:49:14.387151 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 22/42] 10.222.0.76 () {60 vars in 1190 bytes} [Thu Jun 16 14:49:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:15.263457 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-699f7d29-5629-437f-8a4a-b16d3cc8acb0 admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:15.264512 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-699f7d29-5629-437f-8a4a-b16d3cc8acb0 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 16 14:49:15.264916 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 21/43] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Jun 16 14:49:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:15.456197 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-07ddfe6e-dbec-471d-9b53-b65d3543e4e8 admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:15.461717 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.wsgi [None req-07ddfe6e-dbec-471d-9b53-b65d3543e4e8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-07ddfe6e-dbec-471d-9b53-b65d3543e4e8 admin admin] Request method failure captured: Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Accept: application/json Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Accept-Encoding: gzip, deflate Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Connection: keep-alive Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Content-Length: 0 Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Host: 10.222.0.76 Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Openstack-Api-Version: compute 2.90 Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Openstack-System-Scope: None Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: User-Agent: python-novaclient Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Auth-Token: gAAAAABiq0Lr71iT97Gxh6DEPQFXLLD0mkL_-Xq2nhI30RMjVfyIM92Ii9y9qLXJeWb2bdkw6Jd0bmvX59hH_1RfGGDk95p7LD4rJDuJ_4MzGCaDmNxWjUWfGRbsMb6RwEdnNRGYpWOJMMGM6S9L5U8Cz3mQYrUjjLeccpov53B83XksBa6evQY Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Domain-Id: None Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Domain-Name: None Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Identity-Status: Confirmed Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Is-Admin-Project: True Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Project-Domain-Id: default Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Project-Domain-Name: Default Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Project-Id: cd241c469a14403da8a00ae7230e80b3 Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Project-Name: admin Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Role: member,admin,reader Jun 16 14:49:15.463230 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Roles: member,admin,reader Jun 16 14:49:15.464820 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:49:15.464820 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Tenant: admin Jun 16 14:49:15.464820 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Tenant-Id: cd241c469a14403da8a00ae7230e80b3 Jun 16 14:49:15.464820 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Tenant-Name: admin Jun 16 14:49:15.464820 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-User: admin Jun 16 14:49:15.464820 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-User-Domain-Id: default Jun 16 14:49:15.464820 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-User-Domain-Name: Default Jun 16 14:49:15.464820 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-User-Id: b18c82c77c244d2f9aa2c245612ee1a2 Jun 16 14:49:15.464820 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-User-Name: admin Jun 16 14:49:15.464820 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: method: > Jun 16 14:49:15.464820 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: exception: Flavor 84 could not be found. Jun 16 14:49:15.464820 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: action_args: {'id': '84'} Jun 16 14:49:15.464820 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:15.464820 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:15.465850 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:15.467214 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:15.467214 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:15.467214 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:15.467214 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:15.467214 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 14:49:15.467214 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:15.467214 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 14:49:15.467214 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Jun 16 14:49:15.467214 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:15.467214 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Jun 16 14:49:15.467214 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:15.467214 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:15.467214 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:15.467214 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:15.467214 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:15.467214 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 14:49:15.467214 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Jun 16 14:49:15.467214 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-07ddfe6e-dbec-471d-9b53-b65d3543e4e8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103057) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:15.468521 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-07ddfe6e-dbec-471d-9b53-b65d3543e4e8 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063058 Jun 16 14:49:15.468521 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 23/44] 10.222.0.76 () {60 vars in 1190 bytes} [Thu Jun 16 14:49:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:15.474700 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-79c5f341-478f-4008-b183-62f9a240b39d admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:15.488969 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-79c5f341-478f-4008-b183-62f9a240b39d admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017768 Jun 16 14:49:15.489525 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 22/45] 10.222.0.76 () {60 vars in 1210 bytes} [Thu Jun 16 14:49:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:49:15.499073 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-6dbcdb86-41b2-4a41-834a-015cee2da3bd admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:15.513170 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-6dbcdb86-41b2-4a41-834a-015cee2da3bd admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017618 Jun 16 14:49:15.513699 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 24/46] 10.222.0.76 () {60 vars in 1210 bytes} [Thu Jun 16 14:49:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:49:15.523462 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-76837818-baa7-442a-99c5-7e9f7ae9418c admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:15.528793 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.wsgi [None req-76837818-baa7-442a-99c5-7e9f7ae9418c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-76837818-baa7-442a-99c5-7e9f7ae9418c admin admin] Request method failure captured: Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Accept: application/json Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Accept-Encoding: gzip, deflate Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Connection: keep-alive Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Content-Length: 0 Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Host: 10.222.0.76 Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Openstack-Api-Version: compute 2.90 Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Openstack-System-Scope: None Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: User-Agent: python-novaclient Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Auth-Token: gAAAAABiq0Lr71iT97Gxh6DEPQFXLLD0mkL_-Xq2nhI30RMjVfyIM92Ii9y9qLXJeWb2bdkw6Jd0bmvX59hH_1RfGGDk95p7LD4rJDuJ_4MzGCaDmNxWjUWfGRbsMb6RwEdnNRGYpWOJMMGM6S9L5U8Cz3mQYrUjjLeccpov53B83XksBa6evQY Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Domain-Id: None Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Domain-Name: None Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Identity-Status: Confirmed Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Is-Admin-Project: True Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Project-Domain-Id: default Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Project-Domain-Name: Default Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Project-Id: cd241c469a14403da8a00ae7230e80b3 Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Project-Name: admin Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Role: member,admin,reader Jun 16 14:49:15.530308 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Roles: member,admin,reader Jun 16 14:49:15.531750 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:49:15.531750 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Tenant: admin Jun 16 14:49:15.531750 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Tenant-Id: cd241c469a14403da8a00ae7230e80b3 Jun 16 14:49:15.531750 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Tenant-Name: admin Jun 16 14:49:15.531750 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-User: admin Jun 16 14:49:15.531750 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-User-Domain-Id: default Jun 16 14:49:15.531750 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-User-Domain-Name: Default Jun 16 14:49:15.531750 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-User-Id: b18c82c77c244d2f9aa2c245612ee1a2 Jun 16 14:49:15.531750 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-User-Name: admin Jun 16 14:49:15.531750 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: method: > Jun 16 14:49:15.531750 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: exception: Flavor 84 could not be found. Jun 16 14:49:15.531750 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: action_args: {'id': '84'} Jun 16 14:49:15.531750 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:15.531750 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:15.533188 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:15.534280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:15.534280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:15.534280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:15.534280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:15.534280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 14:49:15.534280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:15.534280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 14:49:15.534280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Jun 16 14:49:15.534280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:15.534280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Jun 16 14:49:15.534280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:15.534280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:15.534280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:15.534280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:15.534280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:15.534280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 14:49:15.534280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Jun 16 14:49:15.534280 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-76837818-baa7-442a-99c5-7e9f7ae9418c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:15.535357 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-76837818-baa7-442a-99c5-7e9f7ae9418c admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012223 Jun 16 14:49:15.535357 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 23/47] 10.222.0.76 () {60 vars in 1190 bytes} [Thu Jun 16 14:49:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:16.464699 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-6dbcdb86-41b2-4a41-834a-015cee2da3bd admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:16.466401 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-6dbcdb86-41b2-4a41-834a-015cee2da3bd admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002424 Jun 16 14:49:16.467062 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 25/48] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Jun 16 14:49:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:16.666985 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-fd3e782d-1e6b-4c7b-a953-0f361a23783d admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:16.674807 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.wsgi [None req-fd3e782d-1e6b-4c7b-a953-0f361a23783d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-fd3e782d-1e6b-4c7b-a953-0f361a23783d admin admin] Request method failure captured: Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Accept: application/json Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Accept-Encoding: gzip, deflate Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Connection: keep-alive Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Content-Length: 0 Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Host: 10.222.0.76 Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Openstack-Api-Version: compute 2.90 Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Openstack-System-Scope: None Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: User-Agent: python-novaclient Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Auth-Token: gAAAAABiq0Ls4igfpDoQ_ifSQje4B731V2yUt2hGAqiadKDoRVKu00WAtgrOkZXhlIQppVhM_oJHhsJfcrPy7tn1tj5QjpecigPtn4j-q6B3kZ-fK3zXVZTgYrAJUdGc8XS7Mv307dbgvlcWUA6LrWDf_G0lJBbrMmGCGHfq2F9AOXOW4g7yFpA Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Domain-Id: None Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Domain-Name: None Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Identity-Status: Confirmed Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Is-Admin-Project: True Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Project-Domain-Id: default Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Project-Domain-Name: Default Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Project-Id: cd241c469a14403da8a00ae7230e80b3 Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Project-Name: admin Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Role: member,admin,reader Jun 16 14:49:16.676518 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Roles: member,admin,reader Jun 16 14:49:16.678763 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:49:16.678763 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Tenant: admin Jun 16 14:49:16.678763 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Tenant-Id: cd241c469a14403da8a00ae7230e80b3 Jun 16 14:49:16.678763 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-Tenant-Name: admin Jun 16 14:49:16.678763 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-User: admin Jun 16 14:49:16.678763 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-User-Domain-Id: default Jun 16 14:49:16.678763 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-User-Domain-Name: Default Jun 16 14:49:16.678763 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-User-Id: b18c82c77c244d2f9aa2c245612ee1a2 Jun 16 14:49:16.678763 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: X-User-Name: admin Jun 16 14:49:16.678763 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: method: > Jun 16 14:49:16.678763 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: exception: Flavor 451 could not be found. Jun 16 14:49:16.678763 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: action_args: {'id': '451'} Jun 16 14:49:16.678763 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:16.678763 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:16.679638 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:16.681521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:16.681521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:16.681521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:16.681521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:16.681521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 14:49:16.681521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:16.681521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 14:49:16.681521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Jun 16 14:49:16.681521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:16.681521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Jun 16 14:49:16.681521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:16.681521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:16.681521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:16.681521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:16.681521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:16.681521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 14:49:16.681521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: ERROR nova.api.openstack.wsgi Jun 16 14:49:16.681521 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-fd3e782d-1e6b-4c7b-a953-0f361a23783d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:16.683123 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-fd3e782d-1e6b-4c7b-a953-0f361a23783d admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.073253 Jun 16 14:49:16.683123 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 24/49] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Jun 16 14:49:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:16.688279 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-10962790-797d-432b-8490-d850e665ef73 admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:16.703089 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-10962790-797d-432b-8490-d850e665ef73 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018318 Jun 16 14:49:16.703729 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 26/50] 10.222.0.76 () {60 vars in 1210 bytes} [Thu Jun 16 14:49:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:49:16.714852 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-b1ada69d-8596-472f-a53a-55cdc6a07d41 admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:16.729937 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-b1ada69d-8596-472f-a53a-55cdc6a07d41 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019317 Jun 16 14:49:16.730513 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 25/51] 10.222.0.76 () {60 vars in 1210 bytes} [Thu Jun 16 14:49:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:49:16.740698 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-79888dd2-e9d6-4f4a-accf-6da0f9697a99 admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:16.746425 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.wsgi [None req-79888dd2-e9d6-4f4a-accf-6da0f9697a99 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-79888dd2-e9d6-4f4a-accf-6da0f9697a99 admin admin] Request method failure captured: Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Accept: application/json Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Accept-Encoding: gzip, deflate Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Connection: keep-alive Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Content-Length: 0 Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Host: 10.222.0.76 Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Openstack-Api-Version: compute 2.90 Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Openstack-System-Scope: None Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: User-Agent: python-novaclient Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Auth-Token: gAAAAABiq0Ls4igfpDoQ_ifSQje4B731V2yUt2hGAqiadKDoRVKu00WAtgrOkZXhlIQppVhM_oJHhsJfcrPy7tn1tj5QjpecigPtn4j-q6B3kZ-fK3zXVZTgYrAJUdGc8XS7Mv307dbgvlcWUA6LrWDf_G0lJBbrMmGCGHfq2F9AOXOW4g7yFpA Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Domain-Id: None Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Domain-Name: None Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Identity-Status: Confirmed Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Is-Admin-Project: True Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Project-Domain-Id: default Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Project-Domain-Name: Default Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Project-Id: cd241c469a14403da8a00ae7230e80b3 Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Project-Name: admin Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Role: member,admin,reader Jun 16 14:49:16.747990 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Roles: member,admin,reader Jun 16 14:49:16.749503 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cd241c469a14403da8a00ae7230e80b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:49:16.749503 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Tenant: admin Jun 16 14:49:16.749503 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Tenant-Id: cd241c469a14403da8a00ae7230e80b3 Jun 16 14:49:16.749503 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-Tenant-Name: admin Jun 16 14:49:16.749503 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-User: admin Jun 16 14:49:16.749503 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-User-Domain-Id: default Jun 16 14:49:16.749503 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-User-Domain-Name: Default Jun 16 14:49:16.749503 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-User-Id: b18c82c77c244d2f9aa2c245612ee1a2 Jun 16 14:49:16.749503 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: X-User-Name: admin Jun 16 14:49:16.749503 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: method: > Jun 16 14:49:16.749503 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: exception: Flavor 451 could not be found. Jun 16 14:49:16.749503 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: action_args: {'id': '451'} Jun 16 14:49:16.749503 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:16.749503 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:16.750449 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:16.762685 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:16.762685 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:16.762685 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:16.762685 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:16.762685 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 14:49:16.762685 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:16.762685 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 14:49:16.762685 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Jun 16 14:49:16.762685 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:16.762685 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Jun 16 14:49:16.762685 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:16.762685 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:16.762685 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:16.762685 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:16.762685 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:16.762685 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 14:49:16.762685 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: ERROR nova.api.openstack.wsgi Jun 16 14:49:16.762685 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-79888dd2-e9d6-4f4a-accf-6da0f9697a99 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103057) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:16.763995 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-79888dd2-e9d6-4f4a-accf-6da0f9697a99 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013024 Jun 16 14:49:16.763995 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 27/52] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Jun 16 14:49:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 14:49:17.636910 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-b1ada69d-8596-472f-a53a-55cdc6a07d41 admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:17.637919 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-b1ada69d-8596-472f-a53a-55cdc6a07d41 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 16 14:49:17.638388 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 26/53] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Jun 16 14:49:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:17.835598 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-b728b0ba-71b1-4768-bc75-234b6094af50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:17.855663 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-b728b0ba-71b1-4768-bc75-234b6094af50 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.075934 Jun 16 14:49:17.856227 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 28/54] 10.222.0.76 () {64 vars in 1235 bytes} [Thu Jun 16 14:49:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:49:18.762371 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-b1ada69d-8596-472f-a53a-55cdc6a07d41 admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:18.763374 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-b1ada69d-8596-472f-a53a-55cdc6a07d41 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 16 14:49:18.763832 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 27/55] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Jun 16 14:49:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:49:18.988424 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-ba21c841-bcf3-4d46-b981-781787fdbfec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:19.013185 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-ba21c841-bcf3-4d46-b981-781787fdbfec admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.094010 Jun 16 14:49:19.013743 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 29/56] 10.222.0.76 () {64 vars in 1235 bytes} [Thu Jun 16 14:49:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:49:19.970250 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-b1ada69d-8596-472f-a53a-55cdc6a07d41 admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:19.971275 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-b1ada69d-8596-472f-a53a-55cdc6a07d41 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002008 Jun 16 14:49:19.974422 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 28/57] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Jun 16 14:49:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:20.179973 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-9e23f01d-180a-4ec1-903d-7a30a6d6893c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:20.200132 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-9e23f01d-180a-4ec1-903d-7a30a6d6893c admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.075681 Jun 16 14:49:20.200672 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 30/58] 10.222.0.76 () {64 vars in 1235 bytes} [Thu Jun 16 14:49:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:49:21.111299 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-b1ada69d-8596-472f-a53a-55cdc6a07d41 admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:21.112346 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-b1ada69d-8596-472f-a53a-55cdc6a07d41 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001988 Jun 16 14:49:21.112752 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 29/59] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Jun 16 14:49:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:21.313874 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-f9a4763f-6387-4682-b5b8-6183012cce0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:21.331861 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-f9a4763f-6387-4682-b5b8-6183012cce0d admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.077659 Jun 16 14:49:21.332414 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 31/60] 10.222.0.76 () {64 vars in 1235 bytes} [Thu Jun 16 14:49:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:49:22.231021 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-b1ada69d-8596-472f-a53a-55cdc6a07d41 admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:22.232293 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-b1ada69d-8596-472f-a53a-55cdc6a07d41 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001703 Jun 16 14:49:22.232712 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 30/61] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Jun 16 14:49:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:49:22.440724 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-eea904b0-5b25-4564-b14f-6dc53cda2d7b admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:22.459726 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-eea904b0-5b25-4564-b14f-6dc53cda2d7b admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.079013 Jun 16 14:49:22.460268 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 32/62] 10.222.0.76 () {60 vars in 1202 bytes} [Thu Jun 16 14:49:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:50:12.076597 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-b1ada69d-8596-472f-a53a-55cdc6a07d41 admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:12.078107 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-b1ada69d-8596-472f-a53a-55cdc6a07d41 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 16 14:50:12.078502 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 31/63] 10.222.0.76 () {54 vars in 930 bytes} [Thu Jun 16 14:50:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:12.089457 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG dbcounter [-] [103057] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:12.139492 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-cfac060b-8c41-4c9f-8048-175f0ce5be1c admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:12.160165 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-cfac060b-8c41-4c9f-8048-175f0ce5be1c admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075405 Jun 16 14:50:12.160726 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 33/64] 10.222.0.76 () {60 vars in 1291 bytes} [Thu Jun 16 14:50:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:12.184500 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-ee0f37f7-552e-40e6-8604-c68c2ce72690 admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:12.188083 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG dbcounter [-] [103058] Writing DB stats nova_api:SELECT=14 {{(pid=103058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:12.194109 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-ee0f37f7-552e-40e6-8604-c68c2ce72690 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013285 Jun 16 14:50:12.194668 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 32/65] 10.222.0.76 () {60 vars in 1282 bytes} [Thu Jun 16 14:50:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:12.207311 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-080bf1ad-ce5b-44d4-8138-ea8e84b275bc admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:12.215319 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-080bf1ad-ce5b-44d4-8138-ea8e84b275bc admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011784 Jun 16 14:50:12.215921 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 34/66] 10.222.0.76 () {60 vars in 1285 bytes} [Thu Jun 16 14:50:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:12.228020 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-224101f4-622d-4e16-9aa6-9f7dc9db2c2c admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:12.235665 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-224101f4-622d-4e16-9aa6-9f7dc9db2c2c admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011197 Jun 16 14:50:12.236223 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 33/67] 10.222.0.76 () {60 vars in 1285 bytes} [Thu Jun 16 14:50:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:12.248035 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-b6958773-afb1-4cb1-9222-6d69bc384475 admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:12.255935 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-b6958773-afb1-4cb1-9222-6d69bc384475 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011580 Jun 16 14:50:12.256478 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 35/68] 10.222.0.76 () {60 vars in 1282 bytes} [Thu Jun 16 14:50:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:34.173849 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-224101f4-622d-4e16-9aa6-9f7dc9db2c2c admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:34.174876 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-224101f4-622d-4e16-9aa6-9f7dc9db2c2c admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 16 14:53:34.175294 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 34/69] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Jun 16 14:53:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:34.336687 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG dbcounter [-] [103057] Writing DB stats nova_api:SELECT=6 {{(pid=103057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:34.453690 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-4e753894-ad2c-4515-b401-6d734e310458 admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:34.454855 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:53:34.454855 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: warnings.warn(msg) Jun 16 14:53:34.456084 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-4e753894-ad2c-4515-b401-6d734e310458 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:34.456529 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-4e753894-ad2c-4515-b401-6d734e310458 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:34.457309 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-4e753894-ad2c-4515-b401-6d734e310458 admin admin] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:34.457744 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-4e753894-ad2c-4515-b401-6d734e310458 admin admin] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:34.492889 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-4e753894-ad2c-4515-b401-6d734e310458 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.157762 Jun 16 14:53:34.492889 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 36/70] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Jun 16 14:53:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:53:35.391200 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-224101f4-622d-4e16-9aa6-9f7dc9db2c2c admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:35.392258 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-224101f4-622d-4e16-9aa6-9f7dc9db2c2c admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jun 16 14:53:35.392661 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 35/71] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Jun 16 14:53:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:35.600526 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-9449f887-7c37-4a89-a47f-b44b2f959bfe admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:35.601805 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:53:35.601805 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: warnings.warn(msg) Jun 16 14:53:35.603046 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-9449f887-7c37-4a89-a47f-b44b2f959bfe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:35.603495 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-9449f887-7c37-4a89-a47f-b44b2f959bfe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:35.604785 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-9449f887-7c37-4a89-a47f-b44b2f959bfe admin admin] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:35.605768 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-9449f887-7c37-4a89-a47f-b44b2f959bfe admin admin] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:35.632089 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-9449f887-7c37-4a89-a47f-b44b2f959bfe admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.088384 Jun 16 14:53:35.633357 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 37/72] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Jun 16 14:53:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:53:46.943298 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-224101f4-622d-4e16-9aa6-9f7dc9db2c2c admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:46.944342 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-224101f4-622d-4e16-9aa6-9f7dc9db2c2c admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jun 16 14:53:46.944763 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 36/73] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Jun 16 14:53:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:47.095431 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG dbcounter [-] [103057] Writing DB stats nova_cell0:SELECT=4 {{(pid=103057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:47.096640 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG dbcounter [-] [103057] Writing DB stats nova_cell1:SELECT=4 {{(pid=103057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:47.097651 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG dbcounter [-] [103057] Writing DB stats nova_api:SELECT=8 {{(pid=103057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:47.147769 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-7f31a8a6-d828-4cb0-8d8a-6adb2a4ccb40 admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:47.148932 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:53:47.148932 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: warnings.warn(msg) Jun 16 14:53:47.150103 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-7f31a8a6-d828-4cb0-8d8a-6adb2a4ccb40 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:47.150539 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-7f31a8a6-d828-4cb0-8d8a-6adb2a4ccb40 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:47.151339 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-7f31a8a6-d828-4cb0-8d8a-6adb2a4ccb40 admin admin] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:47.151892 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-7f31a8a6-d828-4cb0-8d8a-6adb2a4ccb40 admin admin] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:47.176874 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-7f31a8a6-d828-4cb0-8d8a-6adb2a4ccb40 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.090569 Jun 16 14:53:47.177420 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 38/74] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Jun 16 14:53:47 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:53:48.055960 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: DEBUG nova.api.openstack.wsgi [None req-224101f4-622d-4e16-9aa6-9f7dc9db2c2c admin admin] Calling method '>' {{(pid=103058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:48.056966 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: INFO nova.api.openstack.requestlog [None req-224101f4-622d-4e16-9aa6-9f7dc9db2c2c admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 16 14:53:48.057367 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: [pid: 103058|app: 0|req: 37/75] 10.222.0.76 () {56 vars in 1074 bytes} [Thu Jun 16 14:53:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:48.245167 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG nova.api.openstack.wsgi [None req-6b178fa2-889f-4341-9cbd-f53eef477ae9 admin admin] Calling method '>' {{(pid=103057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:48.246341 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:53:48.246341 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: warnings.warn(msg) Jun 16 14:53:48.247520 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-6b178fa2-889f-4341-9cbd-f53eef477ae9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:48.247985 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-6b178fa2-889f-4341-9cbd-f53eef477ae9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:48.248764 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-6b178fa2-889f-4341-9cbd-f53eef477ae9 admin admin] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:48.249189 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: DEBUG oslo_concurrency.lockutils [None req-6b178fa2-889f-4341-9cbd-f53eef477ae9 admin admin] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:48.270180 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: INFO nova.api.openstack.requestlog [None req-6b178fa2-889f-4341-9cbd-f53eef477ae9 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.076430 Jun 16 14:53:48.271204 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: [pid: 103057|app: 0|req: 39/76] 10.222.0.76 () {60 vars in 1193 bytes} [Thu Jun 16 14:53:48 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:54:46.393757 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: Thu Jun 16 14:54:46 2022 - graceful shutdown triggered... Jun 16 14:54:46.394275 dv-cinder-837163-3-iscsi devstack@n-api.service[103057]: Gracefully killing worker 1 (pid: 103057)... Jun 16 14:54:46.396100 dv-cinder-837163-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 14:54:46.396669 dv-cinder-837163-3-iscsi devstack@n-api.service[103058]: Gracefully killing worker 2 (pid: 103058)... Jun 16 14:54:47.394911 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: worker 1 buried after 1 seconds Jun 16 14:54:47.395479 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: worker 2 buried after 1 seconds Jun 16 14:54:47.395479 dv-cinder-837163-3-iscsi devstack@n-api.service[103056]: goodbye to uWSGI. Jun 16 14:54:47.396910 dv-cinder-837163-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 14:54:47.397466 dv-cinder-837163-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 14:54:47.400247 dv-cinder-837163-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 14:54:47.409813 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 14:54:47.412011 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 14:54:47 2022] *** Jun 16 14:54:47.412011 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 14:54:47.412011 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 14:54:47.412011 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: nodename: dv-cinder-837163-3-iscsi Jun 16 14:54:47.412011 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: machine: x86_64 Jun 16 14:54:47.412011 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: clock source: unix Jun 16 14:54:47.412011 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: pcre jit disabled Jun 16 14:54:47.412011 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: detected number of CPU cores: 4 Jun 16 14:54:47.412011 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: current working directory: / Jun 16 14:54:47.412011 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: detected binary path: /usr/bin/uwsgi-core Jun 16 14:54:47.412011 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: your processes number limit is 47680 Jun 16 14:54:47.412011 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: your memory page size is 4096 bytes Jun 16 14:54:47.412011 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: detected max file descriptor number: 2048 Jun 16 14:54:47.412011 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: lock engine: pthread robust mutexes Jun 16 14:54:47.412011 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: thunder lock: enabled Jun 16 14:54:47.413071 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 14:54:47.413071 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 14:54:47.457690 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: Python main interpreter initialized at 0x55cb6a39e9c0 Jun 16 14:54:47.457690 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: python threads support enabled Jun 16 14:54:47.457690 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: your server socket listen backlog is limited to 100 connections Jun 16 14:54:47.457690 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: your mercy for graceful operations on workers is 90 seconds Jun 16 14:54:47.458551 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 14:54:47.458551 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: *** Operational MODE: preforking *** Jun 16 14:54:47.458551 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: *** uWSGI is running in multiple interpreter mode *** Jun 16 14:54:47.458551 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: spawned uWSGI master process (pid: 117427) Jun 16 14:54:47.458583 dv-cinder-837163-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 14:54:47.460527 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: spawned uWSGI worker 1 (pid: 117443, cores: 1) Jun 16 14:54:47.460527 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: spawned uWSGI worker 2 (pid: 117444, cores: 1) Jun 16 14:54:47.460731 dv-cinder-837163-3-iscsi devstack@n-api.service[117427]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 14:54:48.136985 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 14:54:48.139770 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 14:54:49.382344 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:54:49.382344 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: from cryptography.utils import int_from_bytes Jun 16 14:54:49.383067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:54:49.383067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: from cryptography.utils import int_from_bytes Jun 16 14:54:49.415052 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:54:49.415052 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: from cryptography.utils import int_from_bytes Jun 16 14:54:49.415641 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:54:49.415641 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: from cryptography.utils import int_from_bytes Jun 16 14:54:51.850271 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 14:54:51.851192 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 14:54:51.851948 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 14:54:51.852507 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 14:54:51.852970 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 14:54:51.853549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.854081 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.854604 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.855218 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.855970 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.856510 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.857030 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.857539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.858073 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.858529 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.859039 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.859577 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837163-3-iscsi {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.860124 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.860644 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.861151 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.861676 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.862193 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.862720 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.863267 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.864109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.864935 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.865538 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.866059 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.866603 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.867132 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.867655 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.868223 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.868842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.869387 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.869979 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.870636 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837163-3-iscsi {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.871167 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.871710 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.872241 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.872858 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.873375 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.873890 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.874404 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.874946 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.875465 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.876029 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.876559 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.877073 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.877586 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.878107 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.878617 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.879160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.879714 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.880230 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.880748 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.881190 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.881690 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.882205 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.882728 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.883252 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.883734 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.884194 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.884717 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.885241 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.885746 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.886257 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.886767 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.887266 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.887798 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.888299 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.888798 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.889323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.889847 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.890370 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.890886 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.891387 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.891956 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.892583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.893029 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.893541 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.894095 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.895132 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.895638 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.896192 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.896706 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.897213 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.897710 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.898209 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.898710 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.899248 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.899782 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.900231 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.900744 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.901253 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.901770 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.902283 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.902783 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.903296 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.903841 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.904357 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.905144 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.905658 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.906174 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.906677 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.907197 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.907718 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.908244 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.908760 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.909289 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.909819 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.910907 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.911421 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.911981 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.912486 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.913054 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.913574 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.914078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.914605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.915118 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.915628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.916178 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.916760 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.917275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.917791 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.918289 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.918796 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.919308 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.919643 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.919998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.920459 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.920910 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.921359 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.921828 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.922277 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.922725 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.923170 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.923365 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 14:54:51.923853 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 14:54:51.924023 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.924023 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.924186 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 14:54:51.924512 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.924640 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 14:54:51.924724 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.924806 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 14:54:51.924997 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.925164 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.925340 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.925505 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.925670 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.925814 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.926008 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.926369 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.926617 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.926744 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.927030 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.927373 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.927482 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.927721 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.927832 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.928049 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.928148 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.928373 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.928479 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.928705 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.928800 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.928972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.929069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.929295 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.929400 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.929622 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837163-3-iscsi {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.929731 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.929947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.930044 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.930261 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.930369 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.930576 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.930684 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.930903 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.931060 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.931235 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.931473 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.931559 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.931645 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.931910 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.932019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.932245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.932527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.932747 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.932841 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.932952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.933232 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.933414 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.933618 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.933778 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.933932 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.934078 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.934228 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.934381 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.934525 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.934713 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.934871 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.935016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.935204 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.935354 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.935498 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.935656 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.935861 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.936009 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.936189 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.936538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837163-3-iscsi {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.936759 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.936759 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.937470 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.937624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.937779 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.937942 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.938102 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.938247 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.938398 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.938543 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.938695 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.938890 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.939048 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.939201 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.939353 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.939570 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.939775 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.939954 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.940110 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.940261 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.940414 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.940566 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.940712 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.940901 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.941060 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.941223 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.941377 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.941530 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.941682 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.941840 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.942013 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.942239 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.942389 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.942533 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.942692 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.942837 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.943025 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.943183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.943411 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.943573 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.943762 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.943922 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.944077 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.944231 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.944375 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.944519 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.944672 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.944825 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.944970 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.945135 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.945282 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.945490 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.945639 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.945785 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.945936 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.946099 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.946245 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.946403 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.946652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.946802 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.946956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.947608 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.947832 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.947981 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.948126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.948279 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.948456 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.948617 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.948810 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.948964 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.949109 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.949264 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.949417 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.949593 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.949750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.949902 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.950047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.950198 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.950352 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.950495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.950695 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.950885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.951031 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.951214 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.951360 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.951503 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.951661 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.951841 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.951999 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.952143 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.952371 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.952538 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.952730 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.952915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.953064 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.953215 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.953368 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.953608 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.953760 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.953904 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.954048 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.954199 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.954433 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.954591 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.954784 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.954990 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.955183 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.955333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.955486 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.955639 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.955836 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.955983 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.956135 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.956286 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.956442 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.956594 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.957710 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.957877 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.958035 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.958179 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.958324 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.958475 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.958630 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.958776 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.958992 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.959155 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.959344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.959535 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.959710 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.959873 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.960026 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.960189 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.960345 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.960503 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.960649 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.960792 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.960944 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.961095 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.961246 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.961434 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.961592 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.961744 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.961906 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.962059 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.962213 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.962384 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.962597 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.962597 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.962876 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.963028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.963182 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.963341 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.963766 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.963933 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.964097 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.964253 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.964417 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.964563 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.964707 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.964707 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.965013 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.965163 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.965314 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.965493 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.965651 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.965651 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.965943 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.965943 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.966234 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.966396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.966396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.966683 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.966683 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.967048 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.967201 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.967382 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.967382 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.968112 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.968268 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.968414 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.968565 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.968710 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.968878 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.969025 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.969025 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.969919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.970071 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.970225 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.970372 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.970517 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.970662 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.970943 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.971115 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.971281 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.971427 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.971579 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.971826 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.971989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.972135 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.972280 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.972484 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.973233 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.973402 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.973549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.973755 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.973989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.974152 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.974297 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.974456 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.974610 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.974762 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.974918 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.975074 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:54:51.975227 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.975381 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.975578 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.975764 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.975952 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.976103 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.976273 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.976273 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.976566 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.976711 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.976857 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.977002 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.977263 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.977414 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.977578 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.978164 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.978325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.978479 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.978651 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.978797 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.978950 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.979095 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.979247 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.979406 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.979560 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.979738 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.979898 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.980050 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.980202 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.980356 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.980502 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.980657 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.980804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.980947 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.981099 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.981257 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.981403 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.981557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.981557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.981879 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.982025 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.982182 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.982182 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.982455 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.982455 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.982993 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.983143 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.983390 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.983581 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.983772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.984028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.984195 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.984356 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.984664 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.984819 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.984986 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.985147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.985316 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.985495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.985584 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.985670 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.985762 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.985846 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.985928 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.986019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.986112 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.986203 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.986287 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.986369 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.986458 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.986554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.986646 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.986729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.986817 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.986906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.987010 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.987095 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.987178 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.987286 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.987372 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.987455 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.987551 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.987636 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.987924 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.988038 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.988333 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.988442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.988543 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.988635 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.988719 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.988801 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.988891 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.988975 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.989071 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.989163 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.989254 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.989338 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.989428 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.989520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.989604 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.989686 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.989775 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.989775 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.989953 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.990051 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.990144 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.990227 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.990309 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.990398 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.990487 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.990580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.990662 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.990751 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.990751 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.990909 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.990909 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.991066 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.991066 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.991223 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.991306 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.991410 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.991503 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.991736 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.991829 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.991913 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.992034 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.992120 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.992212 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.992303 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.992393 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.992484 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.992580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.992666 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.992749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.992833 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.992912 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.993004 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.993101 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.993185 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.993275 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.993374 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.993458 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.993554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.993637 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.993718 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.993789 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.993869 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.993970 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.994218 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.994218 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.994395 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.994479 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.994560 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.994745 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.994896 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.994981 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.995193 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.995321 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.995518 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.995624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.995860 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.995953 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.996187 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.996286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.996502 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.996603 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.996813 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.996911 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.997121 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.997220 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.997430 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.997536 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.997757 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.997867 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.998071 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.998175 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.998386 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.998498 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.998691 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.998779 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.999000 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.999108 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.999306 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.999406 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.999622 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.999845 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:51.999942 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.000021 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.000255 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.000364 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.000561 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.000663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.000870 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.000962 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.001178 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.001268 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.001488 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.001578 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.001796 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.001888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.002102 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.002192 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.002410 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.002501 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.002718 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.002822 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.003030 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.003128 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.003337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.003435 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.004176 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.004286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.004501 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.004602 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.004820 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.004919 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.005135 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.005235 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.005444 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.005533 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.005753 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.005843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.006072 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.006209 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.006386 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.006484 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.006695 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.006788 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.007008 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.007109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.007331 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.007467 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.007655 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.007888 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.008069 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.008298 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.008388 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.008541 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.008642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.008809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.008917 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.009129 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.009224 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.009446 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.009527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.009756 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.009857 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.010084 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.010174 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.010403 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.010530 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.010713 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.010796 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.011022 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.011102 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.011336 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.011426 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.011645 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.013068 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.013068 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.013268 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.013366 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.013461 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.013560 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.013654 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.013739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.013828 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.013912 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.013994 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.014090 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.014182 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.014274 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.014367 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.014483 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.014565 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.014659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.014743 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.014833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.014923 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.015051 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.015193 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.015361 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.015468 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.015702 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.015813 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.016101 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.016197 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.016408 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.016489 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.016736 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.017192 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.017192 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.017361 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.017447 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.017661 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.017792 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.017984 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.018111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.018344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.018456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.018611 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.018760 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.018922 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.019123 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.019218 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.020002 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.020117 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.020325 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.020417 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.020650 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.020749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.020968 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.021059 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.021285 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.021386 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.021605 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.021693 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.021912 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.022009 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.022218 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.022323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.022525 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.022625 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.022839 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.022956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.023151 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.023268 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.023455 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.023546 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.023800 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.023904 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.024121 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.024221 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.024429 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.024531 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.024739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.024851 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.025063 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.025164 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.025378 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.025481 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.025684 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.025776 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.025989 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.026143 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.026305 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.026433 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.026612 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.026709 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.026926 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.027030 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.027240 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.027342 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.027556 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.027647 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.027896 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.028009 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.028209 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.028309 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.028524 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.028618 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.028837 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.028952 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.029144 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.029240 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.029463 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.029565 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.030032 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.030139 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.030341 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.030440 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.030653 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.030754 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.030967 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.031067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.031275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.031367 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.031584 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.031730 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.031918 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.032010 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.032234 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.032336 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.032543 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.032645 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.032857 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.032994 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.033254 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.033366 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.033483 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.033626 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.033787 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.033930 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.034248 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.034348 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.034567 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.034683 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.034912 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.035016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.035236 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.035336 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.035551 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.035649 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.035981 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.036073 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.036308 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.036405 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.036626 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.036942 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.037033 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.037252 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.037350 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.037562 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.037667 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.037879 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.037970 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.038212 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.038384 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.038532 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.038626 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.038819 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.038931 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.039118 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.039259 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.039423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.039513 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.039809 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.039959 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.040170 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.040312 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.040455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.040604 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.040747 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.040896 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.041037 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.041177 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.041317 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.041549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.041720 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.041887 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.042028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.042283 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.042431 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.042536 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.042714 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.042862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.043006 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.043167 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.043314 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.043531 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.043710 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.043818 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.043945 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.044051 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.044166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.044267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.044497 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.044591 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.044829 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.044922 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.045149 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.045250 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.045470 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.045574 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.045779 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.045878 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.046085 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.046184 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.046412 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.046504 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.046721 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.046813 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.047028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.047199 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.047333 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.047461 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.047643 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.047816 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.047987 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.048138 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.048293 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.048468 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.048606 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.048802 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.048903 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.049117 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.049210 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.049428 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.049520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.049747 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.049855 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.050063 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.050164 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.050374 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.050466 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.050727 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.050834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.051041 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.051141 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.051360 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.051451 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.051667 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.051807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.052003 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.052097 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.052312 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.052404 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.052616 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.052719 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.052935 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.053035 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.053243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.053343 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.053615 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.053729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.053865 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.053965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.054171 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.054271 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.054476 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.054569 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.054787 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.054879 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.055096 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.055197 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.055403 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.055512 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.055735 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.055839 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.056046 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.056139 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.056352 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.056445 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.056659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.056751 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.056972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.057063 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.057348 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.057451 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.057591 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.057746 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.057910 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.058022 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.058212 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.058308 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.058530 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.058621 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.058839 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.058994 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.059229 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.059349 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.059438 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.059522 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.059772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.059883 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.060081 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.060183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.060392 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.060494 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.060698 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.060803 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.061003 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.061104 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.061308 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.061407 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.061612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.061713 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.061917 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.062018 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.062239 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.062333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.062549 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.062643 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.062857 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.062949 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.063162 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.063259 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.063467 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.063570 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.063812 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.063946 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.064128 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.064269 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.064438 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.064634 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.064734 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.064946 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.065046 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.065266 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.065359 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.065587 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.065690 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.065903 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.066010 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.066741 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.066844 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.067062 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.067169 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.067370 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.067477 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.067712 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.067822 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.068029 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.068121 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.068343 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.068444 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.068651 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.068743 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.068957 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.069050 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.069281 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.069377 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.069596 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.069689 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.069910 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.070010 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.070233 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.070333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.070541 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.070633 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.070861 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.070953 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.071167 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.071267 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.071479 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.071579 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.071817 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.072065 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.072172 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.072402 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.072503 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.072724 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.072822 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.073040 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.073144 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.073353 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.073454 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.073668 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.073772 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.073983 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.074084 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.074301 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.074394 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.074618 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.074718 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.074934 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.075026 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.075250 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.075396 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.075583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.075707 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.075942 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.076035 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.076256 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.076348 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.076563 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.076668 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.076875 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.076977 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.077183 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.077285 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.077497 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.077598 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.077804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.077895 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.078232 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.078326 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.078546 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.078637 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.078855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.078958 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.079161 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.079264 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.079471 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.079565 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.079883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.079983 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.080209 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.080304 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.080526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.080619 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.080833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.080924 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.081151 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.081257 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.081469 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.081561 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.081830 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.082425 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.082656 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.082759 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.082979 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.083079 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.083299 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.083397 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.083612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.083734 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.083987 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.084079 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.084295 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.084386 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.084603 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.084697 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.084907 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.085000 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.085230 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.085430 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.085536 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.085769 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.085903 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.086092 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.086253 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.086422 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.086568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.086752 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.086876 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.087078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.087293 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.087386 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.087610 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.087754 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.087950 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.088044 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.088276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.088458 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.088778 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.088876 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.089024 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.089115 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.089345 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.089502 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.089667 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.089783 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.089981 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.090084 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.090293 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.090427 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.090619 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.090723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.090929 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.091020 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.091245 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.091470 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.091570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.091863 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.091975 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.092193 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.092293 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.092515 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.092615 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.092847 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.092940 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.093170 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.093268 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.093484 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.093574 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.093817 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.093928 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.094137 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.094311 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.094452 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.094596 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.094747 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.094898 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.095063 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.095212 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.095364 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.095507 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.095674 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.095851 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.096003 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.096154 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.096297 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.096440 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.096611 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.096717 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.096925 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.097025 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.097233 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.097332 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.097567 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.097667 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.097876 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.097977 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.098184 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.098277 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.098494 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.098586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.098799 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.098891 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.099107 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.099200 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.099415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.099613 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.099802 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.099901 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.100049 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.100158 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.100433 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.100552 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.100660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.100746 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.100979 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.101082 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.101284 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.101386 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.101593 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.101698 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.101897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.101994 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.102210 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.102315 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.102540 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.102633 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.102870 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.102960 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.103185 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.103288 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.103494 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.103585 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.103837 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.103997 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.104272 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.104483 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.104640 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.104785 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.104938 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.105094 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.105250 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.105393 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.105544 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.105701 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.105799 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.105886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.106044 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.106242 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.106357 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.106582 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.106683 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.106908 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.107002 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.107247 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.107340 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.107559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.107672 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.107892 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.108001 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.108195 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.108296 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.108502 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.108592 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.108827 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.108918 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.109134 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.109226 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.109450 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.109603 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.109758 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.109908 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.110053 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.110195 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.110343 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.110498 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.110658 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.110873 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.111014 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.111156 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.111306 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.111462 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.111605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.111864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.112003 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.112153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.112302 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.112455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.112603 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.112751 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.112894 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.113062 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.113209 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.113352 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.113494 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.113635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.113814 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.113966 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.114123 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.114267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.114447 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.114564 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.114770 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.114862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.115084 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.115181 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.115400 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.115491 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.115737 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.115916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.116072 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.116216 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.116365 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.116513 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.116655 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.116804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.117003 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.117184 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.117317 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.117516 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.117746 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.117847 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.118067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.118161 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.118396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.118703 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.118803 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.119027 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.119127 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.119340 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.119430 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.119654 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.119899 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.119989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.120061 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.120317 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.120418 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.120635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.120736 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.120966 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.121070 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.121289 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.121389 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.121617 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.121720 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.121948 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.122049 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.122261 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.122362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.122572 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.122674 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.122882 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.122981 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.123197 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.123290 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.123520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.123613 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.123874 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.123981 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.124181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.124292 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.124487 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.124579 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.124802 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.124904 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.125108 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.125210 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.125417 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.125510 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.125726 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.125819 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.126037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.126153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.126348 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.126440 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.126653 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.126746 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.126962 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.127073 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.127269 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.127369 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.127576 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.127711 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.127910 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.128004 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.128218 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.128320 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.128531 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.128650 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.129392 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.129490 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.129669 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.129762 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.129980 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.130073 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.130289 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.130506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.130599 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.130825 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.130915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.131159 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.131271 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.131486 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.131581 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.131836 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.131934 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.132158 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.132261 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.132478 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.132571 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.132813 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.132905 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.133122 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.133224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.133462 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.133611 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.133743 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.133844 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.134053 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.134155 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.134360 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.134463 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.134684 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.134821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.134998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.135091 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.135303 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.135504 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.135598 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.135707 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.135943 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.136038 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.136263 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.136496 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.136597 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.136847 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.136983 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.137165 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.137266 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.137494 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.137594 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.137822 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.137915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.138141 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.138234 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.138450 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.138558 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.138763 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.138862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.139075 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.139175 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.139385 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.139491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.139729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.139862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.140036 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.140174 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.140345 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.140449 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.140653 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.140746 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.140966 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.141057 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.141280 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.141390 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.141585 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.141692 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.141895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.141987 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.142202 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.142304 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.142530 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.142658 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.142844 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.142945 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.143149 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.143244 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.143455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.143555 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.143800 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.143938 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.144108 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.144305 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.144981 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.145078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.145261 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.145402 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.145568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.145669 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.145881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.145974 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 14:54:52.146185 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.146495 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.146803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.147114 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.147419 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.147756 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.148119 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.148445 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.148751 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.149057 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.149376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.149689 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.150010 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.150325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.150637 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.151059 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.151345 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.151867 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.152205 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.152530 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.152869 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.153204 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.153513 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.153822 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.154127 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.154451 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.155507 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.155507 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.155746 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.155961 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.156274 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.156585 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.156897 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.157206 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.157516 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.157823 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.158133 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.158442 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.158751 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.159068 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.159412 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.159769 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.160118 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.160438 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.160758 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.161073 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.161389 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.161702 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.162014 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.162332 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.162665 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.162989 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.163298 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.163745 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.164064 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.164704 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.165041 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.165358 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.165683 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.166009 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.166325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.166649 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.166960 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.167292 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.167635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.167991 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.168319 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.168627 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.168935 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.169241 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.169554 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.169874 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.170187 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.170493 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.170795 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.171105 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.171409 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.171736 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.172045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.172350 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.172660 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.172968 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.173273 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.173575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.173878 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.174182 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.174485 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.174795 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.175099 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.175405 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.175764 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.176075 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.176379 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.176712 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.177045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.177363 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.177685 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.178000 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.178321 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.178631 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.178953 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.179275 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.179593 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.179928 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.180264 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.180576 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.180885 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.181197 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.181509 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.181819 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.182215 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.182539 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.182880 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.183196 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.183525 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.183874 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.184199 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.184518 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.184832 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.185164 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.185478 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.185790 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.186109 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.186421 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.186734 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.187051 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.187369 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.187712 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.188044 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.188357 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.188683 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.189010 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.189357 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.189673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.190017 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.190352 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.190667 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.190980 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.191878 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:54:52.192096 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 14:54:52.209398 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO dbcounter [None req-13d5ec89-c434-479c-9e5b-b670e7e5789c None None] Registered counter for database nova_api Jun 16 14:54:52.230234 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_db.sqlalchemy.engines [None req-13d5ec89-c434-479c-9e5b-b670e7e5789c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:54:52.237225 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writer thread running {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:54:52.255247 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO dbcounter [None req-3719da47-e697-4d5c-b78b-b0d7cfd7868e None None] Registered counter for database nova_api Jun 16 14:54:52.278039 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_db.sqlalchemy.engines [None req-3719da47-e697-4d5c-b78b-b0d7cfd7868e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:54:52.287863 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writer thread running {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:54:52.301353 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.context [None req-13d5ec89-c434-479c-9e5b-b670e7e5789c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),58914df1-3604-4005-8544-4e2578c5de60(cell1) {{(pid=117444) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 14:54:52.305626 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-13d5ec89-c434-479c-9e5b-b670e7e5789c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:54:52.307252 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-13d5ec89-c434-479c-9e5b-b670e7e5789c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:54:52.308114 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-13d5ec89-c434-479c-9e5b-b670e7e5789c None None] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:54:52.310066 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-13d5ec89-c434-479c-9e5b-b670e7e5789c None None] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:54:52.312083 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO dbcounter [None req-13d5ec89-c434-479c-9e5b-b670e7e5789c None None] Registered counter for database nova_cell0 Jun 16 14:54:52.315951 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO dbcounter [None req-13d5ec89-c434-479c-9e5b-b670e7e5789c None None] Registered counter for database nova_cell1 Jun 16 14:54:52.324318 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_db.sqlalchemy.engines [None req-13d5ec89-c434-479c-9e5b-b670e7e5789c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:54:52.328892 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_db.sqlalchemy.engines [None req-13d5ec89-c434-479c-9e5b-b670e7e5789c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:54:52.331086 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writer thread running {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:54:52.349305 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.context [None req-3719da47-e697-4d5c-b78b-b0d7cfd7868e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),58914df1-3604-4005-8544-4e2578c5de60(cell1) {{(pid=117443) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 14:54:52.354905 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3719da47-e697-4d5c-b78b-b0d7cfd7868e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:54:52.356498 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3719da47-e697-4d5c-b78b-b0d7cfd7868e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:54:52.357305 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3719da47-e697-4d5c-b78b-b0d7cfd7868e None None] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:54:52.359249 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3719da47-e697-4d5c-b78b-b0d7cfd7868e None None] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:54:52.361246 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO dbcounter [None req-3719da47-e697-4d5c-b78b-b0d7cfd7868e None None] Registered counter for database nova_cell0 Jun 16 14:54:52.365730 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO dbcounter [None req-3719da47-e697-4d5c-b78b-b0d7cfd7868e None None] Registered counter for database nova_cell1 Jun 16 14:54:52.373220 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_db.sqlalchemy.engines [None req-3719da47-e697-4d5c-b78b-b0d7cfd7868e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:54:52.375402 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_db.sqlalchemy.engines [None req-3719da47-e697-4d5c-b78b-b0d7cfd7868e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:54:52.381782 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writer thread running {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:54:52.383045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writer thread running {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:54:52.478176 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writer thread running {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:54:52.487868 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO dbcounter [None req-13d5ec89-c434-479c-9e5b-b670e7e5789c None None] Registered counter for database nova_cell0 Jun 16 14:54:52.495093 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_db.sqlalchemy.engines [None req-13d5ec89-c434-479c-9e5b-b670e7e5789c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:54:52.499696 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writer thread running {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:54:52.530638 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO dbcounter [None req-3719da47-e697-4d5c-b78b-b0d7cfd7868e None None] Registered counter for database nova_cell0 Jun 16 14:54:52.538682 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_db.sqlalchemy.engines [None req-3719da47-e697-4d5c-b78b-b0d7cfd7868e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:54:52.543391 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writer thread running {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:54:52.832488 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: WARNING keystonemiddleware.auth_token [None req-13d5ec89-c434-479c-9e5b-b670e7e5789c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:54:52.840261 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: WARNING keystonemiddleware.auth_token [None req-13d5ec89-c434-479c-9e5b-b670e7e5789c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:54:52.867810 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: WARNING keystonemiddleware.auth_token [None req-3719da47-e697-4d5c-b78b-b0d7cfd7868e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:54:52.874974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: WARNING keystonemiddleware.auth_token [None req-3719da47-e697-4d5c-b78b-b0d7cfd7868e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:54:53.195408 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: WARNING keystonemiddleware.auth_token [None req-13d5ec89-c434-479c-9e5b-b670e7e5789c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:54:53.201393 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: WARNING keystonemiddleware.auth_token [None req-13d5ec89-c434-479c-9e5b-b670e7e5789c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:54:53.206680 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cb6a39e9c0 pid: 117444 (default app) Jun 16 14:54:53.220909 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: WARNING keystonemiddleware.auth_token [None req-3719da47-e697-4d5c-b78b-b0d7cfd7868e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:54:53.227362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: WARNING keystonemiddleware.auth_token [None req-3719da47-e697-4d5c-b78b-b0d7cfd7868e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:54:53.232706 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cb6a39e9c0 pid: 117443 (default app) Jun 16 14:55:34.538171 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:34.539004 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:34.539928 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:34.541030 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:35.398360 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=3 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:35.400528 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=3 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:35.404643 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=3 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:35.405916 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=3 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:35.739640 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2f4467e9-2e13-4e6e-990c-de9e4eccaa86 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Action: 'create', calling method: .version_select at 0x7f33e3391790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2082376730"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:55:35.927404 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-cde49371-08f2-4afa-a11a-f7bcbb3d2cab tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] Calling method '.version_select at 0x7f33e33e1430>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:37.126101 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-cde49371-08f2-4afa-a11a-f7bcbb3d2cab tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/4eec1cdc-b734-4c16-a5c8-585ea10d2700" status: 200 len: 351 microversion: 2.1 time: 1.739147 Jun 16 14:55:37.128538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 1/1] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Jun 16 14:55:35 2022] GET /compute/v2.1/os-volumes/4eec1cdc-b734-4c16-a5c8-585ea10d2700 => generated 351 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:55:37.620521 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2f4467e9-2e13-4e6e-990c-de9e4eccaa86 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.092983 Jun 16 14:55:37.621629 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 1/2] 10.222.0.76 () {60 vars in 1154 bytes} [Thu Jun 16 14:55:34 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3096 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 14:55:37.636843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e6b7114b-391b-4ead-8957-0e884ac4550d tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e329e5e0>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:38.194982 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e6b7114b-391b-4ead-8957-0e884ac4550d tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184" status: 200 len: 346 microversion: 2.1 time: 0.564070 Jun 16 14:55:38.196215 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 2/3] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Jun 16 14:55:37 2022] GET /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184 => generated 346 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:38.210679 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d28ff123-b237-41fc-98af-4e5167b7385c tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Action: 'create', calling method: .version_select at 0x7f33e325b550>, body: {"snapshot": {"volume_id": "ae8a6bf5-daab-4e4a-a2e7-9e8410159184", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1089153826"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:55:38.692763 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d28ff123-b237-41fc-98af-4e5167b7385c tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.488830 Jun 16 14:55:38.694034 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 2/4] 10.222.0.76 () {60 vars in 1161 bytes} [Thu Jun 16 14:55:38 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:38.704694 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-5ecc3ce0-c5c9-4943-a167-50335542be92 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e329ed30>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:39.027752 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-5ecc3ce0-c5c9-4943-a167-50335542be92 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a" status: 200 len: 287 microversion: 2.1 time: 0.327215 Jun 16 14:55:39.028635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 3/5] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Jun 16 14:55:38 2022] GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a => generated 287 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:39.039600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f4cc1554-545b-4546-b6a4-40c62c6d0c69 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e325b5e0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:39.118743 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f4cc1554-545b-4546-b6a4-40c62c6d0c69 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.083483 Jun 16 14:55:39.119908 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 3/6] 10.222.0.76 () {58 vars in 1139 bytes} [Thu Jun 16 14:55:39 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:39.131424 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3e404438-78c8-4b37-8533-96da549f15f7 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e329edc0>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:39.175255 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3e404438-78c8-4b37-8533-96da549f15f7 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a" status: 200 len: 287 microversion: 2.1 time: 0.048040 Jun 16 14:55:39.176201 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 4/7] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Jun 16 14:55:39 2022] GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:55:39.442003 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9e0edad5-e8ac-4f5a-b1e4-e803c1eab4ab tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] Calling method '.version_select at 0x7f33e3274310>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:39.536107 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9e0edad5-e8ac-4f5a-b1e4-e803c1eab4ab tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/28ec053e-db9e-48bc-ad80-24b59f3d6d16" status: 200 len: 350 microversion: 2.1 time: 0.100050 Jun 16 14:55:39.536660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 4/8] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Jun 16 14:55:39 2022] GET /compute/v2.1/os-volumes/28ec053e-db9e-48bc-ad80-24b59f3d6d16 => generated 350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:40.189209 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-5bb499ea-1172-457c-b583-f875ded1d252 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e329e5e0>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:40.374179 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-5bb499ea-1172-457c-b583-f875ded1d252 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a" status: 200 len: 287 microversion: 2.1 time: 0.189176 Jun 16 14:55:40.380486 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 5/9] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Jun 16 14:55:40 2022] GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a => generated 287 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:41.386451 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f6528f6c-b657-4c12-a55c-146280ae1e4f tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e3274a60>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:41.429111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f6528f6c-b657-4c12-a55c-146280ae1e4f tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a" status: 200 len: 287 microversion: 2.1 time: 0.046747 Jun 16 14:55:41.430023 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 5/10] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Jun 16 14:55:41 2022] GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:42.442089 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3ff36e19-07df-4ea2-806c-2041a6be46e7 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e325d550>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:42.623343 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3ff36e19-07df-4ea2-806c-2041a6be46e7 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a" status: 200 len: 288 microversion: 2.1 time: 0.185899 Jun 16 14:55:42.628961 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 6/11] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Jun 16 14:55:42 2022] GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a => generated 288 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:42.634549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b65512ae-f4d0-4c80-8e45-52ee8e5a3de0 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e325baf0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:42.765962 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b65512ae-f4d0-4c80-8e45-52ee8e5a3de0 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "DELETE /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a" status: 202 len: 0 microversion: 2.1 time: 0.135511 Jun 16 14:55:42.766851 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 6/12] 10.222.0.76 () {58 vars in 1253 bytes} [Thu Jun 16 14:55:42 2022] DELETE /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:55:42.775507 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-27251dfb-45d6-40d4-9fcf-2f6fe7e2cce5 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e329e5e0>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:42.847859 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-27251dfb-45d6-40d4-9fcf-2f6fe7e2cce5 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a" status: 200 len: 287 microversion: 2.1 time: 0.076461 Jun 16 14:55:42.848429 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 7/13] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Jun 16 14:55:42 2022] GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:43.470031 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-765335a9-8eff-4d64-8035-3040e9c318ea tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Action: 'create', calling method: .version_select at 0x7f33e325b670>, body: {"keypair": {"name": "tempest-keypair-1942964515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKF51XNqPfdYkmPSBhCEN4as3hCydcvABsR7kEsZKVAekKPI7LFErM/St/hSmGPOdADwqYeFnXG7Y/v/RdDaqDwZvHOnAY/DrQjFUyyZpvwWV0Pw5Tliee7k6AdS237d0A=="}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:55:43.608596 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-765335a9-8eff-4d64-8035-3040e9c318ea tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Getting quotas for project 60ade68614ac4730a35c9958123d06e8. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:55:43.617144 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-765335a9-8eff-4d64-8035-3040e9c318ea tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Getting quotas for user 87a6ec62b5414930bf36f69f072d7df6 and project 60ade68614ac4730a35c9958123d06e8. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:55:43.759547 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-765335a9-8eff-4d64-8035-3040e9c318ea tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.355747 Jun 16 14:55:43.765659 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 7/14] 10.222.0.76 () {60 vars in 1158 bytes} [Thu Jun 16 14:55:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:43.782692 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-cb4eecec-4cfe-44d0-9ca9-5190c5b30940 tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] Calling method '.version_select at 0x7f33e329edc0>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:43.860497 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d81e3b22-7bc8-447d-8fb4-f43abb5475c2 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e31d4700>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:43.957914 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-cb4eecec-4cfe-44d0-9ca9-5190c5b30940 tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/030bec7c-2f39-4def-b0fc-c8a94ffcf9ba" status: 200 len: 350 microversion: 2.1 time: 0.179802 Jun 16 14:55:43.967418 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 8/15] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Jun 16 14:55:43 2022] GET /compute/v2.1/os-volumes/030bec7c-2f39-4def-b0fc-c8a94ffcf9ba => generated 350 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:43.981529 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-5d92368d-31d1-47a5-859b-34cb1a9332c0 tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] Calling method '.version_select at 0x7f33e325d790>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:44.003576 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d81e3b22-7bc8-447d-8fb4-f43abb5475c2 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a" status: 200 len: 287 microversion: 2.1 time: 0.147243 Jun 16 14:55:44.008763 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 8/16] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Jun 16 14:55:43 2022] GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a => generated 287 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:55:44.319965 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-5d92368d-31d1-47a5-859b-34cb1a9332c0 tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.351061 Jun 16 14:55:44.321421 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 9/17] 10.222.0.76 () {58 vars in 1133 bytes} [Thu Jun 16 14:55:43 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:55:44.346187 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-fda90db3-2478-4b14-90cb-a4f93a107efd tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] Calling method '.version_select at 0x7f33e29840d0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:44.552484 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-fda90db3-2478-4b14-90cb-a4f93a107efd tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.211893 Jun 16 14:55:44.553057 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 9/18] 10.222.0.76 () {58 vars in 1148 bytes} [Thu Jun 16 14:55:44 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:44.567783 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3756c2f3-bdf6-4d94-aca2-0413a7b18aaf tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] Calling method '.version_select at 0x7f33e329ec10>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:44.763462 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3756c2f3-bdf6-4d94-aca2-0413a7b18aaf tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.200182 Jun 16 14:55:44.764505 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 10/19] 10.222.0.76 () {58 vars in 1133 bytes} [Thu Jun 16 14:55:44 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:55:44.776696 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-31ca418a-281f-465b-80ff-4a3bb57f6825 tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] Calling method '.version_select at 0x7f33e2984d30>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:44.915632 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-31ca418a-281f-465b-80ff-4a3bb57f6825 tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.142824 Jun 16 14:55:44.916368 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 10/20] 10.222.0.76 () {58 vars in 1166 bytes} [Thu Jun 16 14:55:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:44.930143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4948b916-bef8-41b9-a5fd-30f3de343c6f tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] Calling method '.version_select at 0x7f33e325d670>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:45.021326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f7337bca-250c-4765-b079-1a0c8e33679a tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e29848b0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:45.091394 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4948b916-bef8-41b9-a5fd-30f3de343c6f tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.165004 Jun 16 14:55:45.092487 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 11/21] 10.222.0.76 () {58 vars in 1169 bytes} [Thu Jun 16 14:55:44 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:45.098801 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f7337bca-250c-4765-b079-1a0c8e33679a tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a" status: 200 len: 287 microversion: 2.1 time: 0.085608 Jun 16 14:55:45.106585 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 11/22] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Jun 16 14:55:45 2022] GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:45.110352 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-bab70791-70aa-4dc1-8879-e7e41825b38e tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] Calling method '.version_select at 0x7f33e32703a0>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:45.391549 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-bab70791-70aa-4dc1-8879-e7e41825b38e tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.285698 Jun 16 14:55:45.392149 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 12/23] 10.222.0.76 () {58 vars in 1154 bytes} [Thu Jun 16 14:55:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:55:45.403349 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a71354a8-d3fe-471e-b998-41cdd8c24d58 tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] Calling method '.version_select at 0x7f33e2984280>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:45.599201 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a71354a8-d3fe-471e-b998-41cdd8c24d58 tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.199542 Jun 16 14:55:45.600168 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 12/24] 10.222.0.76 () {58 vars in 1187 bytes} [Thu Jun 16 14:55:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:45.614118 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f1d1147f-4b9c-4d79-8a50-43c181af5894 tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] Calling method '.version_select at 0x7f33e325d8b0>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:45.817440 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f1d1147f-4b9c-4d79-8a50-43c181af5894 tempest-VolumesTestJSON-1737238840 tempest-VolumesTestJSON-1737238840-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.207539 Jun 16 14:55:45.818873 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 13/25] 10.222.0.76 () {58 vars in 1154 bytes} [Thu Jun 16 14:55:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:55:46.115823 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-df7ab64c-1f6e-484a-a1c1-fcba33e736db tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e31d4790>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:46.169270 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-df7ab64c-1f6e-484a-a1c1-fcba33e736db tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] HTTP exception thrown: Snapshot f400bad4-2ccf-4791-bf27-951160d1b59a could not be found. Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-df7ab64c-1f6e-484a-a1c1-fcba33e736db tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Request method failure captured: Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a HTTP/1.1 Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0RmZngBeurHI-h0moxrXe-sr43ogjuxWRrSiJzpnNkD2WUnZiWhTvBW4qPDTbBZY32PwaXViiGGMANZfb1h8PO8NXK6-XkjBbm6c7r94Hj8lbYpQWFEJabFfShNuydrUOz0ZLX-jzh3OtJJMfZunD1f9emzXExDZ3Uw_-AVVEjOZdY Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 88677f6de5b3408ba3029c2f968b662a Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-848866080 Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 14:55:46.176291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 14:55:46.178563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/88677f6de5b3408ba3029c2f968b662a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88677f6de5b3408ba3029c2f968b662a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_88677f6de5b3408ba3029c2f968b662a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88677f6de5b3408ba3029c2f968b662a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:55:46.178563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-VolumesSnapshotsTestJSON-848866080 Jun 16 14:55:46.178563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 88677f6de5b3408ba3029c2f968b662a Jun 16 14:55:46.178563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-848866080 Jun 16 14:55:46.178563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-VolumesSnapshotsTestJSON-848866080-project Jun 16 14:55:46.178563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 14:55:46.178563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 14:55:46.178563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 5b60d06daff34eb7893eff4f76970a96 Jun 16 14:55:46.178563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-VolumesSnapshotsTestJSON-848866080-project Jun 16 14:55:46.178563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: Jun 16 14:55:46.178563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Snapshot f400bad4-2ccf-4791-bf27-951160d1b59a could not be found. Jun 16 14:55:46.178563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': 'f400bad4-2ccf-4791-bf27-951160d1b59a'} Jun 16 14:55:46.178563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:55:46.179456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:55:46.179456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 14:55:46.179456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 14:55:46.179456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 14:55:46.179456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 14:55:46.179456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 14:55:46.179456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 14:55:46.179456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:55:46.179456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:55:46.179456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:55:46.179456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:55:46.179456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:55:46.179456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:55:46.179456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:55:46.179456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:55:46.179456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f400bad4-2ccf-4791-bf27-951160d1b59a could not be found. (HTTP 404) (Request-ID: req-b47928be-e944-4398-ab1e-41d0546c34a5) Jun 16 14:55:46.179456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:55:46.179456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:55:46.180563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f400bad4-2ccf-4791-bf27-951160d1b59a could not be found. Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 14:55:46.182078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:55:46.183848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f400bad4-2ccf-4791-bf27-951160d1b59a could not be found. Jun 16 14:55:46.183848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:55:46.183848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:55:46.183848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:55:46.183848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:55:46.183848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:55:46.183848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:55:46.183848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:55:46.183848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:55:46.183848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f400bad4-2ccf-4791-bf27-951160d1b59a could not be found. Jun 16 14:55:46.183848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:55:46.183848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-df7ab64c-1f6e-484a-a1c1-fcba33e736db tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Returning 404 to user: Snapshot f400bad4-2ccf-4791-bf27-951160d1b59a could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:55:46.183848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-df7ab64c-1f6e-484a-a1c1-fcba33e736db tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a" status: 404 len: 111 microversion: 2.1 time: 0.071623 Jun 16 14:55:46.196025 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b0a89d15-baff-45e5-a806-989adc6159ac tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e329e700>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:46.203149 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 13/26] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Jun 16 14:55:46 2022] GET /compute/v2.1/os-snapshots/f400bad4-2ccf-4791-bf27-951160d1b59a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:55:46.333352 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b0a89d15-baff-45e5-a806-989adc6159ac tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184" status: 202 len: 0 microversion: 2.1 time: 0.140081 Jun 16 14:55:46.339258 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 14/27] 10.222.0.76 () {58 vars in 1247 bytes} [Thu Jun 16 14:55:46 2022] DELETE /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:55:46.345033 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-09c2d974-5b03-4150-91a6-a72701c0bd3d tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e296b040>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:46.475039 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-09c2d974-5b03-4150-91a6-a72701c0bd3d tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184" status: 200 len: 345 microversion: 2.1 time: 0.134624 Jun 16 14:55:46.480568 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 14/28] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Jun 16 14:55:46 2022] GET /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184 => generated 345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:47.488265 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-05974ab0-12a0-476b-a6ed-88a5cff7331f tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e3c3eaf0>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:47.585091 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-05974ab0-12a0-476b-a6ed-88a5cff7331f tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184" status: 200 len: 345 microversion: 2.1 time: 0.100683 Jun 16 14:55:47.585876 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 15/29] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Jun 16 14:55:47 2022] GET /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184 => generated 345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:48.600611 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8986b0f3-bd3d-46dc-add0-d2c0e5e3b823 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e296b790>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:48.768507 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8986b0f3-bd3d-46dc-add0-d2c0e5e3b823 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184" status: 200 len: 345 microversion: 2.1 time: 0.172863 Jun 16 14:55:48.774238 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 15/30] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Jun 16 14:55:48 2022] GET /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184 => generated 345 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:49.608187 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-fe63f9d1-bf77-484c-b5e4-231d23c5e607 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-468691829", "imageRef": "f2f37ffa-db20-478d-84c0-b429a987933c", "flavorRef": "452", "networks": [{"uuid": "c3653c3f-b2aa-456a-b419-c1f4ffbb6622"}]}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:55:49.713117 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-58f11a87-c7f5-47f2-9844-69d4b3d75ef1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1730506574", "imageRef": "f2f37ffa-db20-478d-84c0-b429a987933c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3e2520f-526d-4c84-9c0f-99f9be8b2582"}], "security_groups": [{"name": "tempest-securitygroup--540596004"}], "key_name": "tempest-keypair-1942964515", "user_data": "}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:55:49.991543 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-58f11a87-c7f5-47f2-9844-69d4b3d75ef1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] validate_networks() for [('f3e2520f-526d-4c84-9c0f-99f9be8b2582', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:55:50.063157 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.network.neutron [None req-fe63f9d1-bf77-484c-b5e4-231d23c5e607 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] validate_networks() for [('c3653c3f-b2aa-456a-b419-c1f4ffbb6622', None, None, None, None, None)] {{(pid=117443) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:55:52.137650 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-58f11a87-c7f5-47f2-9844-69d4b3d75ef1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:55:52.138166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-58f11a87-c7f5-47f2-9844-69d4b3d75ef1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:55:52.138721 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-58f11a87-c7f5-47f2-9844-69d4b3d75ef1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:55:52.138961 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-58f11a87-c7f5-47f2-9844-69d4b3d75ef1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:55:52.139374 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-58f11a87-c7f5-47f2-9844-69d4b3d75ef1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:55:52.151598 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-58f11a87-c7f5-47f2-9844-69d4b3d75ef1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:52.152260 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-58f11a87-c7f5-47f2-9844-69d4b3d75ef1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:52.153268 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-58f11a87-c7f5-47f2-9844-69d4b3d75ef1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:52.153782 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-58f11a87-c7f5-47f2-9844-69d4b3d75ef1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:52.167841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-fe63f9d1-bf77-484c-b5e4-231d23c5e607 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Flavor limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:55:52.168950 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-fe63f9d1-bf77-484c-b5e4-231d23c5e607 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Image limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:55:52.169900 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-fe63f9d1-bf77-484c-b5e4-231d23c5e607 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Flavor pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:55:52.170937 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-fe63f9d1-bf77-484c-b5e4-231d23c5e607 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Image pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:55:52.171475 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-fe63f9d1-bf77-484c-b5e4-231d23c5e607 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:55:52.183942 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-58f11a87-c7f5-47f2-9844-69d4b3d75ef1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Getting quotas for project 60ade68614ac4730a35c9958123d06e8. Resources: {'ram', 'cores', 'instances'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:55:52.189487 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-58f11a87-c7f5-47f2-9844-69d4b3d75ef1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Getting quotas for user 87a6ec62b5414930bf36f69f072d7df6 and project 60ade68614ac4730a35c9958123d06e8. Resources: {'ram', 'cores', 'instances'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:55:52.194482 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fe63f9d1-bf77-484c-b5e4-231d23c5e607 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:52.207023 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-58f11a87-c7f5-47f2-9844-69d4b3d75ef1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:55:52.208727 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fe63f9d1-bf77-484c-b5e4-231d23c5e607 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:52.209878 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fe63f9d1-bf77-484c-b5e4-231d23c5e607 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:52.210381 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-58f11a87-c7f5-47f2-9844-69d4b3d75ef1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2f37ffa-db20-478d-84c0-b429a987933c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:55:52.210767 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fe63f9d1-bf77-484c-b5e4-231d23c5e607 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:52.269345 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-fe63f9d1-bf77-484c-b5e4-231d23c5e607 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Getting quotas for project 8a56373cfeb74f1f9adec2d33c9d5b7f. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:55:52.279659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-fe63f9d1-bf77-484c-b5e4-231d23c5e607 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Getting quotas for user a4eda7cae22441e9a56f1c463a5688b7 and project 8a56373cfeb74f1f9adec2d33c9d5b7f. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:55:52.300379 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-fe63f9d1-bf77-484c-b5e4-231d23c5e607 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Going to run 1 instances... {{(pid=117443) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:55:52.313365 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-fe63f9d1-bf77-484c-b5e4-231d23c5e607 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2f37ffa-db20-478d-84c0-b429a987933c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:55:52.342785 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-58f11a87-c7f5-47f2-9844-69d4b3d75ef1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.650524 Jun 16 14:55:52.344169 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 16/31] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 14:55:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 2654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:55:52.441401 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-fe63f9d1-bf77-484c-b5e4-231d23c5e607 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.992338 Jun 16 14:55:52.442368 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 16/32] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 14:55:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:55:52.448545 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b47304db-e1f6-4f64-8bd0-ffd8c048a91d tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e317b1f0>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:52.489387 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-fbfd3f6d-8367-4bd4-94de-fd0e0de927e5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-388578533", "imageRef": "f2f37ffa-db20-478d-84c0-b429a987933c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:55:52.510965 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-b47304db-e1f6-4f64-8bd0-ffd8c048a91d tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] HTTP exception thrown: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b47304db-e1f6-4f64-8bd0-ffd8c048a91d tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Request method failure captured: Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: GET /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184 HTTP/1.1 Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0RmZngBeurHI-h0moxrXe-sr43ogjuxWRrSiJzpnNkD2WUnZiWhTvBW4qPDTbBZY32PwaXViiGGMANZfb1h8PO8NXK6-XkjBbm6c7r94Hj8lbYpQWFEJabFfShNuydrUOz0ZLX-jzh3OtJJMfZunD1f9emzXExDZ3Uw_-AVVEjOZdY Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 88677f6de5b3408ba3029c2f968b662a Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-848866080 Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 14:55:52.518437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 14:55:52.519538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/88677f6de5b3408ba3029c2f968b662a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88677f6de5b3408ba3029c2f968b662a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_88677f6de5b3408ba3029c2f968b662a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88677f6de5b3408ba3029c2f968b662a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:55:52.519538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-VolumesSnapshotsTestJSON-848866080 Jun 16 14:55:52.519538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 88677f6de5b3408ba3029c2f968b662a Jun 16 14:55:52.519538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-848866080 Jun 16 14:55:52.519538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-VolumesSnapshotsTestJSON-848866080-project Jun 16 14:55:52.519538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 14:55:52.519538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 14:55:52.519538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: 5b60d06daff34eb7893eff4f76970a96 Jun 16 14:55:52.519538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-VolumesSnapshotsTestJSON-848866080-project Jun 16 14:55:52.519538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: Jun 16 14:55:52.519538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. Jun 16 14:55:52.519538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': 'ae8a6bf5-daab-4e4a-a2e7-9e8410159184'} Jun 16 14:55:52.519538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. (HTTP 404) (Request-ID: req-cf4cf9ce-e865-4253-8f39-745760edd760) Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:55:52.520168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:55:52.521276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 14:55:52.524092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:55:52.525028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. Jun 16 14:55:52.525028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:52.525028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:55:52.525028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:52.525028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:55:52.525028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:55:52.525028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:55:52.525028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:55:52.525028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:55:52.525028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. Jun 16 14:55:52.525028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:52.525028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b47304db-e1f6-4f64-8bd0-ffd8c048a91d tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Returning 404 to user: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:55:52.525028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b47304db-e1f6-4f64-8bd0-ffd8c048a91d tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184" status: 404 len: 109 microversion: 2.1 time: 0.076338 Jun 16 14:55:52.525028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 17/33] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Jun 16 14:55:52 2022] GET /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:55:52.641862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8281cd3f-4b7a-4665-aa46-f6dc9928eba0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Action: 'create', calling method: .version_select at 0x7f33e20e45e0>, body: {"keypair": {"name": "tempest-keypair-1775340934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfxZPX5EaYxFyeJuiyca7AaIEvYO0PbWYJCYhAOnZyVmPHsKUzWi2+nOZRr7k21gbOtD5/AfH2vDPQnjA5hlAgpXiPNghwHtCT5YaIEAG7M5cIzSzVQ/JuOFupW+/DF3w=="}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:55:52.689346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-fbfd3f6d-8367-4bd4-94de-fd0e0de927e5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] validate_networks() for [('f2b19b75-a6b3-4999-bad1-72b8dbee6346', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:55:52.739413 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-8281cd3f-4b7a-4665-aa46-f6dc9928eba0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Getting quotas for project 2893d1739fb84d7c8a2311ef4aab72e5. Resources: {'key_pairs'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:55:52.749867 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-8281cd3f-4b7a-4665-aa46-f6dc9928eba0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Getting quotas for user 7c31b2060e83410482ac2bef20b0556e and project 2893d1739fb84d7c8a2311ef4aab72e5. Resources: {'key_pairs'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:55:52.852451 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8281cd3f-4b7a-4665-aa46-f6dc9928eba0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.327459 Jun 16 14:55:52.854092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 18/34] 10.222.0.76 () {62 vars in 1199 bytes} [Thu Jun 16 14:55:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 332 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 14:55:52.864955 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ad38fe12-7f10-4e8e-9136-0e7a92d64d2c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:52.874832 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ad38fe12-7f10-4e8e-9136-0e7a92d64d2c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:55:53.360950 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ad38fe12-7f10-4e8e-9136-0e7a92d64d2c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:55:53.393713 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ad38fe12-7f10-4e8e-9136-0e7a92d64d2c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1242 microversion: 2.1 time: 0.532965 Jun 16 14:55:53.398434 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 19/35] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:55:52 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1242 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:55:53.445660 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-57d4b782-aa4a-4dec-9eb9-131fbb736795 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:53.450290 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-57d4b782-aa4a-4dec-9eb9-131fbb736795 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:55:53.931639 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-57d4b782-aa4a-4dec-9eb9-131fbb736795 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:55:53.943346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-57d4b782-aa4a-4dec-9eb9-131fbb736795 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1214 microversion: 2.1 time: 0.543641 Jun 16 14:55:53.945243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 20/36] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:55:53 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1214 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:55:53.960092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1427c0f1-a935-487d-b723-8cbc46ecd35e tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e18b1310>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:54.095301 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-1427c0f1-a935-487d-b723-8cbc46ecd35e tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] HTTP exception thrown: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1427c0f1-a935-487d-b723-8cbc46ecd35e tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Request method failure captured: Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: DELETE /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184 HTTP/1.1 Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0RmZngBeurHI-h0moxrXe-sr43ogjuxWRrSiJzpnNkD2WUnZiWhTvBW4qPDTbBZY32PwaXViiGGMANZfb1h8PO8NXK6-XkjBbm6c7r94Hj8lbYpQWFEJabFfShNuydrUOz0ZLX-jzh3OtJJMfZunD1f9emzXExDZ3Uw_-AVVEjOZdY Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 88677f6de5b3408ba3029c2f968b662a Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-848866080 Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 14:55:54.099850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 14:55:54.100978 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/88677f6de5b3408ba3029c2f968b662a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88677f6de5b3408ba3029c2f968b662a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_88677f6de5b3408ba3029c2f968b662a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88677f6de5b3408ba3029c2f968b662a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:55:54.100978 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-VolumesSnapshotsTestJSON-848866080 Jun 16 14:55:54.100978 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 88677f6de5b3408ba3029c2f968b662a Jun 16 14:55:54.100978 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-848866080 Jun 16 14:55:54.100978 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-VolumesSnapshotsTestJSON-848866080-project Jun 16 14:55:54.100978 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 14:55:54.100978 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 14:55:54.100978 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: 5b60d06daff34eb7893eff4f76970a96 Jun 16 14:55:54.100978 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-VolumesSnapshotsTestJSON-848866080-project Jun 16 14:55:54.100978 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: Jun 16 14:55:54.100978 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. Jun 16 14:55:54.100978 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': 'ae8a6bf5-daab-4e4a-a2e7-9e8410159184'} Jun 16 14:55:54.100978 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. (HTTP 404) (Request-ID: req-077f88d8-3746-4759-8054-481d065ff709) Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:55:54.101697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 14:55:54.102673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 14:55:54.103538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:55:54.106575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. Jun 16 14:55:54.106575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:54.106575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:55:54.106575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:54.106575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:55:54.106575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:55:54.106575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:55:54.106575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:55:54.106575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:55:54.106575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. Jun 16 14:55:54.106575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:54.106575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1427c0f1-a935-487d-b723-8cbc46ecd35e tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Returning 404 to user: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:55:54.106575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1427c0f1-a935-487d-b723-8cbc46ecd35e tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184" status: 404 len: 109 microversion: 2.1 time: 0.152495 Jun 16 14:55:54.106575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 21/37] 10.222.0.76 () {58 vars in 1247 bytes} [Thu Jun 16 14:55:53 2022] DELETE /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184 => generated 109 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:55:54.114909 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-88dd9362-dd9e-4f95-b690-c7896ba514d9 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Calling method '.version_select at 0x7f33e317b1f0>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:54.153369 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-88dd9362-dd9e-4f95-b690-c7896ba514d9 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] HTTP exception thrown: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-88dd9362-dd9e-4f95-b690-c7896ba514d9 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Request method failure captured: Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: GET /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184 HTTP/1.1 Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0RmZngBeurHI-h0moxrXe-sr43ogjuxWRrSiJzpnNkD2WUnZiWhTvBW4qPDTbBZY32PwaXViiGGMANZfb1h8PO8NXK6-XkjBbm6c7r94Hj8lbYpQWFEJabFfShNuydrUOz0ZLX-jzh3OtJJMfZunD1f9emzXExDZ3Uw_-AVVEjOZdY Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 88677f6de5b3408ba3029c2f968b662a Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-848866080 Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 14:55:54.155995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 14:55:54.157270 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/88677f6de5b3408ba3029c2f968b662a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88677f6de5b3408ba3029c2f968b662a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_88677f6de5b3408ba3029c2f968b662a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/88677f6de5b3408ba3029c2f968b662a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:55:54.157270 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-VolumesSnapshotsTestJSON-848866080 Jun 16 14:55:54.157270 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 88677f6de5b3408ba3029c2f968b662a Jun 16 14:55:54.157270 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-848866080 Jun 16 14:55:54.157270 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-VolumesSnapshotsTestJSON-848866080-project Jun 16 14:55:54.157270 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 14:55:54.157270 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 14:55:54.157270 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: 5b60d06daff34eb7893eff4f76970a96 Jun 16 14:55:54.157270 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-VolumesSnapshotsTestJSON-848866080-project Jun 16 14:55:54.157270 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: Jun 16 14:55:54.157270 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. Jun 16 14:55:54.157270 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': 'ae8a6bf5-daab-4e4a-a2e7-9e8410159184'} Jun 16 14:55:54.157270 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. (HTTP 404) (Request-ID: req-bb554468-e10f-4861-8da9-b2f5e64d3752) Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:55:54.157934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:55:54.158884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 14:55:54.162286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:55:54.163862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. Jun 16 14:55:54.163862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:54.163862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:55:54.163862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:54.163862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:55:54.163862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:55:54.163862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:55:54.163862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:55:54.163862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:55:54.163862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. Jun 16 14:55:54.163862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:55:54.165795 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-88dd9362-dd9e-4f95-b690-c7896ba514d9 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] Returning 404 to user: Volume ae8a6bf5-daab-4e4a-a2e7-9e8410159184 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:55:54.167300 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-88dd9362-dd9e-4f95-b690-c7896ba514d9 tempest-VolumesSnapshotsTestJSON-848866080 tempest-VolumesSnapshotsTestJSON-848866080-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184" status: 404 len: 109 microversion: 2.1 time: 0.059391 Jun 16 14:55:54.168092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 22/38] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Jun 16 14:55:54 2022] GET /compute/v2.1/os-volumes/ae8a6bf5-daab-4e4a-a2e7-9e8410159184 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:55:54.415864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-2d71bdf0-fe69-478c-9e36-81bd0b06c75a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:54.418465 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-2d71bdf0-fe69-478c-9e36-81bd0b06c75a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:55:54.517862 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-fbfd3f6d-8367-4bd4-94de-fd0e0de927e5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:55:54.519006 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-fbfd3f6d-8367-4bd4-94de-fd0e0de927e5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:55:54.519777 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-fbfd3f6d-8367-4bd4-94de-fd0e0de927e5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:55:54.520840 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-fbfd3f6d-8367-4bd4-94de-fd0e0de927e5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:55:54.521611 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-fbfd3f6d-8367-4bd4-94de-fd0e0de927e5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:55:54.548505 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fbfd3f6d-8367-4bd4-94de-fd0e0de927e5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:54.550133 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fbfd3f6d-8367-4bd4-94de-fd0e0de927e5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:54.553204 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fbfd3f6d-8367-4bd4-94de-fd0e0de927e5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:54.554442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fbfd3f6d-8367-4bd4-94de-fd0e0de927e5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:54.595664 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2d71bdf0-fe69-478c-9e36-81bd0b06c75a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:55:54.613311 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-2d71bdf0-fe69-478c-9e36-81bd0b06c75a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1242 microversion: 2.1 time: 0.199840 Jun 16 14:55:54.618930 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 23/39] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:55:54 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1242 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:55:54.638842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-fbfd3f6d-8367-4bd4-94de-fd0e0de927e5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Getting quotas for project 2b653a9971874ddb8a49b265e3783ff3. Resources: {'ram', 'cores', 'instances'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:55:54.652816 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-fbfd3f6d-8367-4bd4-94de-fd0e0de927e5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Getting quotas for user dc31b47df1904f9da0b5c7f370b74132 and project 2b653a9971874ddb8a49b265e3783ff3. Resources: {'ram', 'cores', 'instances'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:55:54.682680 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-fbfd3f6d-8367-4bd4-94de-fd0e0de927e5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:55:54.690549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-fbfd3f6d-8367-4bd4-94de-fd0e0de927e5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2f37ffa-db20-478d-84c0-b429a987933c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:55:54.818750 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-fbfd3f6d-8367-4bd4-94de-fd0e0de927e5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.471907 Jun 16 14:55:54.819484 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 17/40] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 14:55:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 2475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:55:54.831795 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ff539a40-e6a4-4745-877b-3f61de8d9209 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:54.832983 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ff539a40-e6a4-4745-877b-3f61de8d9209 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:55:54.965569 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e7d7ad3d-d96f-405f-a6a3-c9ed02d4cc6f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:54.966584 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e7d7ad3d-d96f-405f-a6a3-c9ed02d4cc6f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:55:54.988099 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ff539a40-e6a4-4745-877b-3f61de8d9209 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:55:54.999435 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ff539a40-e6a4-4745-877b-3f61de8d9209 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1221 microversion: 2.1 time: 0.173313 Jun 16 14:55:55.000583 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 24/41] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:55:54 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1221 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:55:55.011318 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7d7ad3d-d96f-405f-a6a3-c9ed02d4cc6f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:55.012134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7d7ad3d-d96f-405f-a6a3-c9ed02d4cc6f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:55.030969 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7d7ad3d-d96f-405f-a6a3-c9ed02d4cc6f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:55.031562 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7d7ad3d-d96f-405f-a6a3-c9ed02d4cc6f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:55.339661 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-dd920755-423d-48d5-baa0-59ad4771e15e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-306431277", "imageRef": "f2f37ffa-db20-478d-84c0-b429a987933c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:55:55.495188 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.network.neutron [None req-dd920755-423d-48d5-baa0-59ad4771e15e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] validate_networks() for [('f2b19b75-a6b3-4999-bad1-72b8dbee6346', None, None, None, None, None)] {{(pid=117443) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:55:56.075231 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e7d7ad3d-d96f-405f-a6a3-c9ed02d4cc6f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:55:56.151892 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e7d7ad3d-d96f-405f-a6a3-c9ed02d4cc6f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1218 microversion: 2.1 time: 1.189864 Jun 16 14:55:56.155708 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 18/42] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:55:54 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1218 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:55:56.176526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d8939de1-c69b-4940-88a9-8752ab6b2a12 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:56.179906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d8939de1-c69b-4940-88a9-8752ab6b2a12 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:55:56.195481 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d8939de1-c69b-4940-88a9-8752ab6b2a12 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:56.196347 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d8939de1-c69b-4940-88a9-8752ab6b2a12 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:56.199179 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d8939de1-c69b-4940-88a9-8752ab6b2a12 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:56.200343 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d8939de1-c69b-4940-88a9-8752ab6b2a12 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:56.463853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d8939de1-c69b-4940-88a9-8752ab6b2a12 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:55:56.472263 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d8939de1-c69b-4940-88a9-8752ab6b2a12 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1294 microversion: 2.1 time: 0.315070 Jun 16 14:55:56.473901 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 19/43] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:55:56 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1294 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:55:57.171539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e037af83-c9d0-4530-9a2e-055ef3bf96c8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:57.173315 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e037af83-c9d0-4530-9a2e-055ef3bf96c8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:55:57.189704 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e037af83-c9d0-4530-9a2e-055ef3bf96c8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:57.193755 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e037af83-c9d0-4530-9a2e-055ef3bf96c8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:57.199656 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e037af83-c9d0-4530-9a2e-055ef3bf96c8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:57.200215 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e037af83-c9d0-4530-9a2e-055ef3bf96c8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:57.364151 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-dd920755-423d-48d5-baa0-59ad4771e15e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Flavor limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:55:57.365215 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-dd920755-423d-48d5-baa0-59ad4771e15e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Image limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:55:57.366175 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-dd920755-423d-48d5-baa0-59ad4771e15e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Flavor pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:55:57.366743 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-dd920755-423d-48d5-baa0-59ad4771e15e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Image pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:55:57.367349 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-dd920755-423d-48d5-baa0-59ad4771e15e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:55:57.404797 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dd920755-423d-48d5-baa0-59ad4771e15e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:57.406392 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dd920755-423d-48d5-baa0-59ad4771e15e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:57.410295 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dd920755-423d-48d5-baa0-59ad4771e15e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:57.410762 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dd920755-423d-48d5-baa0-59ad4771e15e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:57.498102 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-dd920755-423d-48d5-baa0-59ad4771e15e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Getting quotas for project 2b653a9971874ddb8a49b265e3783ff3. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:55:57.530366 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-dd920755-423d-48d5-baa0-59ad4771e15e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Getting quotas for user dc31b47df1904f9da0b5c7f370b74132 and project 2b653a9971874ddb8a49b265e3783ff3. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:55:57.590089 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-dd920755-423d-48d5-baa0-59ad4771e15e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Going to run 1 instances... {{(pid=117443) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:55:57.597748 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-dd920755-423d-48d5-baa0-59ad4771e15e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2f37ffa-db20-478d-84c0-b429a987933c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:55:57.622620 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e037af83-c9d0-4530-9a2e-055ef3bf96c8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:55:57.638133 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e037af83-c9d0-4530-9a2e-055ef3bf96c8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1274 microversion: 2.1 time: 0.468826 Jun 16 14:55:57.639738 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 20/44] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:55:57 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1274 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:55:57.661530 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ff8c826e-e530-455d-a050-54edf58b9fc6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:57.684398 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ff8c826e-e530-455d-a050-54edf58b9fc6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:55:57.698579 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ff8c826e-e530-455d-a050-54edf58b9fc6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:57.699032 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ff8c826e-e530-455d-a050-54edf58b9fc6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:57.710317 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ff8c826e-e530-455d-a050-54edf58b9fc6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:57.713594 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ff8c826e-e530-455d-a050-54edf58b9fc6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:57.840121 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-dd920755-423d-48d5-baa0-59ad4771e15e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.511681 Jun 16 14:55:57.847205 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 25/45] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 14:55:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 2528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:55:57.862717 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-32691a81-30d1-419e-b36b-4393dfc6fdc9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:57.863356 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-32691a81-30d1-419e-b36b-4393dfc6fdc9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:55:58.523671 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ff8c826e-e530-455d-a050-54edf58b9fc6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:55:58.565736 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ff8c826e-e530-455d-a050-54edf58b9fc6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1312 microversion: 2.1 time: 0.920660 Jun 16 14:55:58.570067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 21/46] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:55:57 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1312 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:55:58.584370 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-32691a81-30d1-419e-b36b-4393dfc6fdc9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:55:58.592076 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-32691a81-30d1-419e-b36b-4393dfc6fdc9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1221 microversion: 2.1 time: 0.742532 Jun 16 14:55:58.604846 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 26/47] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:55:57 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1221 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:55:58.657864 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0d260ef0-b68b-4cf4-bdd9-0d206821a12c tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:58.660263 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0d260ef0-b68b-4cf4-bdd9-0d206821a12c tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:55:58.672729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0d260ef0-b68b-4cf4-bdd9-0d206821a12c tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:58.673235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0d260ef0-b68b-4cf4-bdd9-0d206821a12c tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:58.674597 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0d260ef0-b68b-4cf4-bdd9-0d206821a12c tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:58.675090 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0d260ef0-b68b-4cf4-bdd9-0d206821a12c tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:59.472442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0d260ef0-b68b-4cf4-bdd9-0d206821a12c tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:55:59.488127 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0d260ef0-b68b-4cf4-bdd9-0d206821a12c tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1272 microversion: 2.1 time: 0.831600 Jun 16 14:55:59.491740 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 22/48] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:55:58 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1272 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:55:59.588349 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4a0861c6-9bdd-4d0f-9f8f-4b22488ff638 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:59.589726 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4a0861c6-9bdd-4d0f-9f8f-4b22488ff638 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:55:59.605889 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4a0861c6-9bdd-4d0f-9f8f-4b22488ff638 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:59.613644 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9825f329-2286-48be-a630-343dbe22a4e5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1804340606", "imageRef": "f2f37ffa-db20-478d-84c0-b429a987933c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb632b7c-5874-4b1b-ab90-d925d1b84472"}], "security_groups": [{"name": "tempest-securitygroup--643338333"}], "key_name": "tempest-keypair-1775340934", "user_data": "}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:55:59.637445 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4a0861c6-9bdd-4d0f-9f8f-4b22488ff638 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:59.641872 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4a0861c6-9bdd-4d0f-9f8f-4b22488ff638 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:59.649818 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4a0861c6-9bdd-4d0f-9f8f-4b22488ff638 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:01.265779 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4a0861c6-9bdd-4d0f-9f8f-4b22488ff638 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:01.304222 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4a0861c6-9bdd-4d0f-9f8f-4b22488ff638 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1300 microversion: 2.1 time: 1.706539 Jun 16 14:56:01.324809 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 27/49] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:55:59 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1300 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:01.337523 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e77d1f31-2abb-4c1a-a4dc-4c608ee06ff9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:01.342338 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e77d1f31-2abb-4c1a-a4dc-4c608ee06ff9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:01.360548 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e77d1f31-2abb-4c1a-a4dc-4c608ee06ff9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:01.364404 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e77d1f31-2abb-4c1a-a4dc-4c608ee06ff9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:01.367142 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e77d1f31-2abb-4c1a-a4dc-4c608ee06ff9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:01.369328 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e77d1f31-2abb-4c1a-a4dc-4c608ee06ff9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:01.512605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-9825f329-2286-48be-a630-343dbe22a4e5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] validate_networks() for [('bb632b7c-5874-4b1b-ab90-d925d1b84472', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:56:01.965290 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e77d1f31-2abb-4c1a-a4dc-4c608ee06ff9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:01.979439 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e77d1f31-2abb-4c1a-a4dc-4c608ee06ff9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1279 microversion: 2.1 time: 0.648692 Jun 16 14:56:01.982732 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 28/50] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:01 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1279 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:01.996719 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-bce44cd2-86e4-4823-a8b6-d766bde055a7 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:02.006410 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-bce44cd2-86e4-4823-a8b6-d766bde055a7 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:02.016023 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bce44cd2-86e4-4823-a8b6-d766bde055a7 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:02.016908 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bce44cd2-86e4-4823-a8b6-d766bde055a7 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:02.022316 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bce44cd2-86e4-4823-a8b6-d766bde055a7 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:02.023224 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bce44cd2-86e4-4823-a8b6-d766bde055a7 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:02.800169 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-bce44cd2-86e4-4823-a8b6-d766bde055a7 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:02.808178 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-bce44cd2-86e4-4823-a8b6-d766bde055a7 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1272 microversion: 2.1 time: 0.824101 Jun 16 14:56:02.808758 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 29/51] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:01 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1272 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:03.630870 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1098801b-f963-4046-b997-c14ad198e49b tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] Action: 'create', calling method: .version_select at 0x7f33e17f6dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-495792515", "metadata": {"Type": "work"}}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1098801b-f963-4046-b997-c14ad198e49b tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] Request method failure captured: Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 121 Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0SAIKZxt_r-i_Wi9IlfoSFRBxCvdVEvMQ5qTUJclcWMUxG1z4cxTwH126xmm6ZOXGHSfBmViqqtx6pHTGXvgQ7p1yDTJAi_sn2BBaN_vuj4-q8GufIUnaJZA6msm-UVDtWX3-u3_r5LJSBwGEKGiZGvYPkQvzIE_NlCYsPz6YynmiI Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: c671e431520546ffb646e8271bfb4cb1 Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-VolumesNegativeTest-2065145538 Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 14:56:03.660294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 14:56:03.661740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:56:03.661740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-VolumesNegativeTest-2065145538 Jun 16 14:56:03.661740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: c671e431520546ffb646e8271bfb4cb1 Jun 16 14:56:03.661740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-VolumesNegativeTest-2065145538 Jun 16 14:56:03.661740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-VolumesNegativeTest-2065145538-project Jun 16 14:56:03.661740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 14:56:03.661740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 14:56:03.661740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: 5e14eb5588064945a6e4fd4be46caa1e Jun 16 14:56:03.661740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-VolumesNegativeTest-2065145538-project Jun 16 14:56:03.661740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Jun 16 14:56:03.661740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-495792515", "metadata": {"Type": "work"}}} Jun 16 14:56:03.661740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: Jun 16 14:56:03.661740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-495792515', 'metadata': {'Type': 'work'}}}} Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:56:03.662612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:56:03.664007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:56:03.665105 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 14:56:03.665105 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:03.665105 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1098801b-f963-4046-b997-c14ad198e49b tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:56:03.665325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1098801b-f963-4046-b997-c14ad198e49b tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.848450 Jun 16 14:56:03.665963 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 30/52] 10.222.0.76 () {60 vars in 1155 bytes} [Thu Jun 16 14:56:02 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 850 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:56:03.671144 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-031a3d23-c6db-4993-896f-ec44b572672e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:03.672045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-031a3d23-c6db-4993-896f-ec44b572672e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:03.701327 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-031a3d23-c6db-4993-896f-ec44b572672e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:03.701808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-031a3d23-c6db-4993-896f-ec44b572672e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:03.702576 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-031a3d23-c6db-4993-896f-ec44b572672e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:03.703030 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-031a3d23-c6db-4993-896f-ec44b572672e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:04.183911 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-9825f329-2286-48be-a630-343dbe22a4e5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:56:04.185193 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-9825f329-2286-48be-a630-343dbe22a4e5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:56:04.186022 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-9825f329-2286-48be-a630-343dbe22a4e5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:56:04.186744 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-9825f329-2286-48be-a630-343dbe22a4e5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:56:04.187481 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-9825f329-2286-48be-a630-343dbe22a4e5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:56:04.215425 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9825f329-2286-48be-a630-343dbe22a4e5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:04.216683 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9825f329-2286-48be-a630-343dbe22a4e5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:04.218262 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9825f329-2286-48be-a630-343dbe22a4e5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:04.226004 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9825f329-2286-48be-a630-343dbe22a4e5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:04.324418 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-9825f329-2286-48be-a630-343dbe22a4e5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Getting quotas for project 2893d1739fb84d7c8a2311ef4aab72e5. Resources: {'ram', 'cores', 'instances'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:56:04.332889 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-9825f329-2286-48be-a630-343dbe22a4e5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Getting quotas for user 7c31b2060e83410482ac2bef20b0556e and project 2893d1739fb84d7c8a2311ef4aab72e5. Resources: {'ram', 'cores', 'instances'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:56:04.388308 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9825f329-2286-48be-a630-343dbe22a4e5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:56:04.405972 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9825f329-2286-48be-a630-343dbe22a4e5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2f37ffa-db20-478d-84c0-b429a987933c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:56:04.560046 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9825f329-2286-48be-a630-343dbe22a4e5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.951818 Jun 16 14:56:04.567779 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 23/53] 10.222.0.76 () {62 vars in 1187 bytes} [Thu Jun 16 14:55:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 4960 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 16 14:56:04.593421 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e1bc5a2d-4143-4e97-9897-abe7b174d334 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:04.595736 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e1bc5a2d-4143-4e97-9897-abe7b174d334 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:04.645602 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=10 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:04.684889 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1bc5a2d-4143-4e97-9897-abe7b174d334 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:04.687797 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1bc5a2d-4143-4e97-9897-abe7b174d334 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:04.688751 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1bc5a2d-4143-4e97-9897-abe7b174d334 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:04.689228 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1bc5a2d-4143-4e97-9897-abe7b174d334 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:05.038445 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e1bc5a2d-4143-4e97-9897-abe7b174d334 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:05.067830 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e1bc5a2d-4143-4e97-9897-abe7b174d334 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1279 microversion: 2.1 time: 0.498523 Jun 16 14:56:05.071210 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 24/54] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:04 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1279 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:05.081804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-282a9e02-4595-4767-b0dc-9854e92fbb64 tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] Action: 'create', calling method: .version_select at 0x7f33e18345e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1506329592", "metadata": {"Type": "work"}}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-282a9e02-4595-4767-b0dc-9854e92fbb64 tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] Request method failure captured: Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 120 Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0SAIKZxt_r-i_Wi9IlfoSFRBxCvdVEvMQ5qTUJclcWMUxG1z4cxTwH126xmm6ZOXGHSfBmViqqtx6pHTGXvgQ7p1yDTJAi_sn2BBaN_vuj4-q8GufIUnaJZA6msm-UVDtWX3-u3_r5LJSBwGEKGiZGvYPkQvzIE_NlCYsPz6YynmiI Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: c671e431520546ffb646e8271bfb4cb1 Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-VolumesNegativeTest-2065145538 Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 14:56:05.103134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 14:56:05.104416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:56:05.104416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-VolumesNegativeTest-2065145538 Jun 16 14:56:05.104416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: c671e431520546ffb646e8271bfb4cb1 Jun 16 14:56:05.104416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-VolumesNegativeTest-2065145538 Jun 16 14:56:05.104416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-VolumesNegativeTest-2065145538-project Jun 16 14:56:05.104416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 14:56:05.104416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 14:56:05.104416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 5e14eb5588064945a6e4fd4be46caa1e Jun 16 14:56:05.104416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-VolumesNegativeTest-2065145538-project Jun 16 14:56:05.104416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Jun 16 14:56:05.104416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1506329592", "metadata": {"Type": "work"}}} Jun 16 14:56:05.104416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: Jun 16 14:56:05.104416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1506329592', 'metadata': {'Type': 'work'}}}} Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi '0' Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:56:05.105166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:56:05.106365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:56:05.107322 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 14:56:05.107322 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.113989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-282a9e02-4595-4767-b0dc-9854e92fbb64 tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:56:05.115028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-282a9e02-4595-4767-b0dc-9854e92fbb64 tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.042502 Jun 16 14:56:05.115759 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 25/55] 10.222.0.76 () {60 vars in 1155 bytes} [Thu Jun 16 14:56:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:56:05.124155 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7185394c-cad6-4ef3-8374-9567314873b4 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:05.124939 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7185394c-cad6-4ef3-8374-9567314873b4 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:05.141693 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7185394c-cad6-4ef3-8374-9567314873b4 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:05.143149 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7185394c-cad6-4ef3-8374-9567314873b4 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:05.155941 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7185394c-cad6-4ef3-8374-9567314873b4 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:05.156788 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7185394c-cad6-4ef3-8374-9567314873b4 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:05.227696 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-031a3d23-c6db-4993-896f-ec44b572672e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:05.241371 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-031a3d23-c6db-4993-896f-ec44b572672e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 1.573913 Jun 16 14:56:05.242669 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 31/56] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:03 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:05.248794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b8f587c3-8beb-41ee-9341-0e1189574802 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:05.249689 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b8f587c3-8beb-41ee-9341-0e1189574802 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:05.594589 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b8f587c3-8beb-41ee-9341-0e1189574802 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:05.630714 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b8f587c3-8beb-41ee-9341-0e1189574802 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:05.635262 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b8f587c3-8beb-41ee-9341-0e1189574802 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:05.638087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b8f587c3-8beb-41ee-9341-0e1189574802 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1282 microversion: 2.20 time: 0.393632 Jun 16 14:56:05.640392 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 32/57] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:05 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1282 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:05.649046 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ab32b900-65bb-43d4-b7c5-67c814c7ede5 tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] Action: 'create', calling method: .version_select at 0x7f33e20e4790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1449931003", "metadata": {"Type": "work"}}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ab32b900-65bb-43d4-b7c5-67c814c7ede5 tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] Request method failure captured: Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 119 Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0SAIKZxt_r-i_Wi9IlfoSFRBxCvdVEvMQ5qTUJclcWMUxG1z4cxTwH126xmm6ZOXGHSfBmViqqtx6pHTGXvgQ7p1yDTJAi_sn2BBaN_vuj4-q8GufIUnaJZA6msm-UVDtWX3-u3_r5LJSBwGEKGiZGvYPkQvzIE_NlCYsPz6YynmiI Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: c671e431520546ffb646e8271bfb4cb1 Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-VolumesNegativeTest-2065145538 Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 14:56:05.653330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 14:56:05.654580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:56:05.654580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-VolumesNegativeTest-2065145538 Jun 16 14:56:05.654580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: c671e431520546ffb646e8271bfb4cb1 Jun 16 14:56:05.654580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-VolumesNegativeTest-2065145538 Jun 16 14:56:05.654580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-VolumesNegativeTest-2065145538-project Jun 16 14:56:05.654580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 14:56:05.654580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 14:56:05.654580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: 5e14eb5588064945a6e4fd4be46caa1e Jun 16 14:56:05.654580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-VolumesNegativeTest-2065145538-project Jun 16 14:56:05.654580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Jun 16 14:56:05.654580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1449931003", "metadata": {"Type": "work"}}} Jun 16 14:56:05.654580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: Jun 16 14:56:05.654580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1449931003', 'metadata': {'Type': 'work'}}}} Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi '' Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:56:05.656520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:56:05.658001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:56:05.660383 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 14:56:05.660383 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.684396 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ab32b900-65bb-43d4-b7c5-67c814c7ede5 tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:56:05.693523 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ab32b900-65bb-43d4-b7c5-67c814c7ede5 tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.050138 Jun 16 14:56:05.696367 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 33/58] 10.222.0.76 () {60 vars in 1155 bytes} [Thu Jun 16 14:56:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:56:05.715619 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-2dfab80f-b75b-426b-bef9-a3be3d85f36c tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] Calling method '.version_select at 0x7f33e1796310>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:05.770518 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-2dfab80f-b75b-426b-bef9-a3be3d85f36c tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] HTTP exception thrown: Volume tempest-invalid-165836135 could not be found. Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-2dfab80f-b75b-426b-bef9-a3be3d85f36c tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] Request method failure captured: Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-165836135 HTTP/1.1 Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0SAIKZxt_r-i_Wi9IlfoSFRBxCvdVEvMQ5qTUJclcWMUxG1z4cxTwH126xmm6ZOXGHSfBmViqqtx6pHTGXvgQ7p1yDTJAi_sn2BBaN_vuj4-q8GufIUnaJZA6msm-UVDtWX3-u3_r5LJSBwGEKGiZGvYPkQvzIE_NlCYsPz6YynmiI Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: c671e431520546ffb646e8271bfb4cb1 Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-VolumesNegativeTest-2065145538 Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 14:56:05.772557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 14:56:05.773776 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:56:05.773776 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-VolumesNegativeTest-2065145538 Jun 16 14:56:05.773776 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: c671e431520546ffb646e8271bfb4cb1 Jun 16 14:56:05.773776 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-VolumesNegativeTest-2065145538 Jun 16 14:56:05.773776 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-VolumesNegativeTest-2065145538-project Jun 16 14:56:05.773776 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 14:56:05.773776 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 14:56:05.773776 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: 5e14eb5588064945a6e4fd4be46caa1e Jun 16 14:56:05.773776 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-VolumesNegativeTest-2065145538-project Jun 16 14:56:05.773776 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: Jun 16 14:56:05.773776 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Volume tempest-invalid-165836135 could not be found. Jun 16 14:56:05.773776 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': 'tempest-invalid-165836135'} Jun 16 14:56:05.773776 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-165836135 could not be found. (HTTP 404) (Request-ID: req-c9521c28-af0a-4063-b88f-5d6fedcac220) Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:56:05.774635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 14:56:05.775568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-165836135 could not be found. Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:56:05.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-165836135 could not be found. Jun 16 14:56:05.777648 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.777648 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:56:05.777648 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.777648 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:05.777648 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:56:05.777648 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:56:05.777648 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:56:05.777648 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:56:05.777648 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-165836135 could not be found. Jun 16 14:56:05.777648 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.777648 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-2dfab80f-b75b-426b-bef9-a3be3d85f36c tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] Returning 404 to user: Volume tempest-invalid-165836135 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:56:05.777648 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-2dfab80f-b75b-426b-bef9-a3be3d85f36c tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/tempest-invalid-165836135" status: 404 len: 98 microversion: 2.1 time: 0.071977 Jun 16 14:56:05.781521 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 34/59] 10.222.0.76 () {58 vars in 1214 bytes} [Thu Jun 16 14:56:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-165836135 => generated 98 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:56:05.789459 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8d22c429-a74c-476f-a57b-51a736b372a0 tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006552 Jun 16 14:56:05.797189 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 35/60] 10.222.0.76 () {58 vars in 1139 bytes} [Thu Jun 16 14:56:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 14:56:05.805663 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-cd78247c-2b09-4ccc-a319-e3f1aa361a7a tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005493 Jun 16 14:56:05.814202 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 36/61] 10.222.0.76 () {58 vars in 1136 bytes} [Thu Jun 16 14:56:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 14:56:05.825282 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-33e2a032-47d5-49a1-bbbf-d2210af9544e tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] Calling method '.version_select at 0x7f33e1829a60>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:05.868352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7185394c-cad6-4ef3-8374-9567314873b4 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:05.876110 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-33e2a032-47d5-49a1-bbbf-d2210af9544e tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] HTTP exception thrown: Volume e8130698-d986-44dc-9999-195253cf21fb could not be found. Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-33e2a032-47d5-49a1-bbbf-d2210af9544e tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] Request method failure captured: Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: DELETE /compute/v2.1/os-volumes/e8130698-d986-44dc-9999-195253cf21fb HTTP/1.1 Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0SAIKZxt_r-i_Wi9IlfoSFRBxCvdVEvMQ5qTUJclcWMUxG1z4cxTwH126xmm6ZOXGHSfBmViqqtx6pHTGXvgQ7p1yDTJAi_sn2BBaN_vuj4-q8GufIUnaJZA6msm-UVDtWX3-u3_r5LJSBwGEKGiZGvYPkQvzIE_NlCYsPz6YynmiI Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: c671e431520546ffb646e8271bfb4cb1 Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-VolumesNegativeTest-2065145538 Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 14:56:05.878642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 14:56:05.879886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:56:05.879886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-VolumesNegativeTest-2065145538 Jun 16 14:56:05.879886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: c671e431520546ffb646e8271bfb4cb1 Jun 16 14:56:05.879886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-VolumesNegativeTest-2065145538 Jun 16 14:56:05.879886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-VolumesNegativeTest-2065145538-project Jun 16 14:56:05.879886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 14:56:05.879886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 14:56:05.879886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: 5e14eb5588064945a6e4fd4be46caa1e Jun 16 14:56:05.879886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-VolumesNegativeTest-2065145538-project Jun 16 14:56:05.879886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: Jun 16 14:56:05.879886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Volume e8130698-d986-44dc-9999-195253cf21fb could not be found. Jun 16 14:56:05.879886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': 'e8130698-d986-44dc-9999-195253cf21fb'} Jun 16 14:56:05.879886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8130698-d986-44dc-9999-195253cf21fb could not be found. (HTTP 404) (Request-ID: req-8cb017fe-41e2-4bec-9dd5-ee07d6c4ff72) Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:56:05.880652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 14:56:05.881739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8130698-d986-44dc-9999-195253cf21fb could not be found. Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 14:56:05.882804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:56:05.883902 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8130698-d986-44dc-9999-195253cf21fb could not be found. Jun 16 14:56:05.883902 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.883902 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:56:05.883902 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.883902 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:05.883902 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:56:05.883902 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:56:05.883902 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:56:05.883902 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:56:05.883902 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8130698-d986-44dc-9999-195253cf21fb could not be found. Jun 16 14:56:05.883902 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.883902 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-33e2a032-47d5-49a1-bbbf-d2210af9544e tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] Returning 404 to user: Volume e8130698-d986-44dc-9999-195253cf21fb could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:56:05.884580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-33e2a032-47d5-49a1-bbbf-d2210af9544e tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/e8130698-d986-44dc-9999-195253cf21fb" status: 404 len: 109 microversion: 2.1 time: 0.064269 Jun 16 14:56:05.884987 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 37/62] 10.222.0.76 () {58 vars in 1247 bytes} [Thu Jun 16 14:56:05 2022] DELETE /compute/v2.1/os-volumes/e8130698-d986-44dc-9999-195253cf21fb => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:56:05.888009 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7185394c-cad6-4ef3-8374-9567314873b4 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.767690 Jun 16 14:56:05.891529 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 26/63] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:05 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:05.914540 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-79b18565-7813-4efc-8882-c69d8e1b5afa tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] Calling method '.version_select at 0x7f33e17f6430>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:05.971781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-79b18565-7813-4efc-8882-c69d8e1b5afa tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] HTTP exception thrown: Volume 008a3b41-0d02-414f-8fdf-649a7d358e2d could not be found. Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-79b18565-7813-4efc-8882-c69d8e1b5afa tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] Request method failure captured: Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: GET /compute/v2.1/os-volumes/008a3b41-0d02-414f-8fdf-649a7d358e2d HTTP/1.1 Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0SAIKZxt_r-i_Wi9IlfoSFRBxCvdVEvMQ5qTUJclcWMUxG1z4cxTwH126xmm6ZOXGHSfBmViqqtx6pHTGXvgQ7p1yDTJAi_sn2BBaN_vuj4-q8GufIUnaJZA6msm-UVDtWX3-u3_r5LJSBwGEKGiZGvYPkQvzIE_NlCYsPz6YynmiI Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: c671e431520546ffb646e8271bfb4cb1 Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-VolumesNegativeTest-2065145538 Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 14:56:05.973794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 14:56:05.975006 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c671e431520546ffb646e8271bfb4cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:56:05.975006 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-VolumesNegativeTest-2065145538 Jun 16 14:56:05.975006 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: c671e431520546ffb646e8271bfb4cb1 Jun 16 14:56:05.975006 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-VolumesNegativeTest-2065145538 Jun 16 14:56:05.975006 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-VolumesNegativeTest-2065145538-project Jun 16 14:56:05.975006 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 14:56:05.975006 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 14:56:05.975006 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: 5e14eb5588064945a6e4fd4be46caa1e Jun 16 14:56:05.975006 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-VolumesNegativeTest-2065145538-project Jun 16 14:56:05.975006 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: Jun 16 14:56:05.975006 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Volume 008a3b41-0d02-414f-8fdf-649a7d358e2d could not be found. Jun 16 14:56:05.975006 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': '008a3b41-0d02-414f-8fdf-649a7d358e2d'} Jun 16 14:56:05.975006 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 008a3b41-0d02-414f-8fdf-649a7d358e2d could not be found. (HTTP 404) (Request-ID: req-030d6338-7eb8-4498-a2c8-30be058498c2) Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:56:05.975740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:56:05.977382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 008a3b41-0d02-414f-8fdf-649a7d358e2d could not be found. Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 14:56:05.978399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:56:05.979436 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 008a3b41-0d02-414f-8fdf-649a7d358e2d could not be found. Jun 16 14:56:05.979436 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.979436 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:56:05.979436 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.979436 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:56:05.979436 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:56:05.979436 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:56:05.979436 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:56:05.979436 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:56:05.979436 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 008a3b41-0d02-414f-8fdf-649a7d358e2d could not be found. Jun 16 14:56:05.979436 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:56:05.979436 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-79b18565-7813-4efc-8882-c69d8e1b5afa tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] Returning 404 to user: Volume 008a3b41-0d02-414f-8fdf-649a7d358e2d could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:56:05.980190 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-79b18565-7813-4efc-8882-c69d8e1b5afa tempest-VolumesNegativeTest-2065145538 tempest-VolumesNegativeTest-2065145538-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/008a3b41-0d02-414f-8fdf-649a7d358e2d" status: 404 len: 109 microversion: 2.1 time: 0.086027 Jun 16 14:56:05.980725 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 38/64] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Jun 16 14:56:05 2022] GET /compute/v2.1/os-volumes/008a3b41-0d02-414f-8fdf-649a7d358e2d => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:56:06.088771 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b810b789-27f5-4453-b352-da5b485c6585 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:06.089591 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b810b789-27f5-4453-b352-da5b485c6585 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:06.102678 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b810b789-27f5-4453-b352-da5b485c6585 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:06.102678 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b810b789-27f5-4453-b352-da5b485c6585 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:06.102678 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b810b789-27f5-4453-b352-da5b485c6585 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:06.103670 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b810b789-27f5-4453-b352-da5b485c6585 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:06.261088 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-142f4df7-caaa-4a4e-8bb0-f3b4f6d64f1d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:06.261958 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-142f4df7-caaa-4a4e-8bb0-f3b4f6d64f1d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:06.294677 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-142f4df7-caaa-4a4e-8bb0-f3b4f6d64f1d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:06.294859 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-142f4df7-caaa-4a4e-8bb0-f3b4f6d64f1d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:06.300357 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-142f4df7-caaa-4a4e-8bb0-f3b4f6d64f1d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:06.309935 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-142f4df7-caaa-4a4e-8bb0-f3b4f6d64f1d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:06.686087 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b810b789-27f5-4453-b352-da5b485c6585 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:06.693948 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b810b789-27f5-4453-b352-da5b485c6585 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1279 microversion: 2.1 time: 0.609453 Jun 16 14:56:06.694522 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 27/65] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:06 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1279 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:06.711402 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-34b1e393-6a56-448f-80ab-bcee33fce84a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:06.712102 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-34b1e393-6a56-448f-80ab-bcee33fce84a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:06.731954 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-34b1e393-6a56-448f-80ab-bcee33fce84a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:06.732409 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-34b1e393-6a56-448f-80ab-bcee33fce84a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:06.733196 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-34b1e393-6a56-448f-80ab-bcee33fce84a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:06.733628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-34b1e393-6a56-448f-80ab-bcee33fce84a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:06.933229 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-34b1e393-6a56-448f-80ab-bcee33fce84a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:06.949717 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-34b1e393-6a56-448f-80ab-bcee33fce84a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:06.961774 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-34b1e393-6a56-448f-80ab-bcee33fce84a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:06.963583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-34b1e393-6a56-448f-80ab-bcee33fce84a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1334 microversion: 2.20 time: 0.268111 Jun 16 14:56:06.964751 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 28/66] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:06 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1334 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:06.971810 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-60153a83-01be-491b-8bb6-113af515f28d tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:06.973681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-60153a83-01be-491b-8bb6-113af515f28d tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:06.998079 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-60153a83-01be-491b-8bb6-113af515f28d tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:06.998921 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-60153a83-01be-491b-8bb6-113af515f28d tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:06.999976 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-60153a83-01be-491b-8bb6-113af515f28d tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:07.000628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-60153a83-01be-491b-8bb6-113af515f28d tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:07.333716 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-142f4df7-caaa-4a4e-8bb0-f3b4f6d64f1d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:07.359104 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-142f4df7-caaa-4a4e-8bb0-f3b4f6d64f1d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 1.103690 Jun 16 14:56:07.379987 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 39/67] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:06 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:07.710860 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-90bd977b-6e00-41aa-bf7e-cb75fbdf454e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:07.711725 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-90bd977b-6e00-41aa-bf7e-cb75fbdf454e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:07.713897 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=4 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:07.742440 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-90bd977b-6e00-41aa-bf7e-cb75fbdf454e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:07.743235 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-90bd977b-6e00-41aa-bf7e-cb75fbdf454e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:07.749734 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-90bd977b-6e00-41aa-bf7e-cb75fbdf454e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:07.750408 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-90bd977b-6e00-41aa-bf7e-cb75fbdf454e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:07.951336 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-60153a83-01be-491b-8bb6-113af515f28d tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:07.973259 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-60153a83-01be-491b-8bb6-113af515f28d tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 1.007142 Jun 16 14:56:07.990926 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 29/68] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:06 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:07.999394 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d3dd0203-4a4e-458e-98ea-53a446ca4c72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:08.004612 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d3dd0203-4a4e-458e-98ea-53a446ca4c72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:08.018599 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d3dd0203-4a4e-458e-98ea-53a446ca4c72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:08.019637 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d3dd0203-4a4e-458e-98ea-53a446ca4c72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:08.020986 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d3dd0203-4a4e-458e-98ea-53a446ca4c72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:08.032544 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d3dd0203-4a4e-458e-98ea-53a446ca4c72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:08.058182 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-90bd977b-6e00-41aa-bf7e-cb75fbdf454e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:08.084327 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-90bd977b-6e00-41aa-bf7e-cb75fbdf454e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1279 microversion: 2.1 time: 0.375686 Jun 16 14:56:08.090122 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 40/69] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:07 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1279 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:08.393440 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-185e69be-829b-40b2-9227-bbec334a666c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:08.396488 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-185e69be-829b-40b2-9227-bbec334a666c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:08.441474 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-185e69be-829b-40b2-9227-bbec334a666c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:08.442736 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-185e69be-829b-40b2-9227-bbec334a666c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:08.446140 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-185e69be-829b-40b2-9227-bbec334a666c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:08.456541 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-185e69be-829b-40b2-9227-bbec334a666c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:08.809043 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d3dd0203-4a4e-458e-98ea-53a446ca4c72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:08.826836 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d3dd0203-4a4e-458e-98ea-53a446ca4c72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:08.829266 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d3dd0203-4a4e-458e-98ea-53a446ca4c72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:08.831596 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d3dd0203-4a4e-458e-98ea-53a446ca4c72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1340 microversion: 2.20 time: 0.838946 Jun 16 14:56:08.833640 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 30/70] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:07 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1340 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:09.350436 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-185e69be-829b-40b2-9227-bbec334a666c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:09.373461 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-185e69be-829b-40b2-9227-bbec334a666c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.987031 Jun 16 14:56:09.378781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 41/71] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:08 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:09.383939 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7e0f9289-f300-43d9-abef-ebe2e838280f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:09.398787 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7e0f9289-f300-43d9-abef-ebe2e838280f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:09.438910 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e0f9289-f300-43d9-abef-ebe2e838280f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:09.441963 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e0f9289-f300-43d9-abef-ebe2e838280f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:09.443012 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e0f9289-f300-43d9-abef-ebe2e838280f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:09.446640 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e0f9289-f300-43d9-abef-ebe2e838280f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:09.446914 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-223b3d6b-d3d4-4f43-babf-e36d41011a9d req-73552d64-bed6-43de-b7b3-e766da2ce8cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb2c36e-f3e4-44bf-bec8-b512d6b0c970", "tag": "f4ee3cc3-a516-4b35-8827-b0d6dbf7a1a8"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:56:09.486528 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-223b3d6b-d3d4-4f43-babf-e36d41011a9d req-73552d64-bed6-43de-b7b3-e766da2ce8cb service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:09.487386 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-223b3d6b-d3d4-4f43-babf-e36d41011a9d req-73552d64-bed6-43de-b7b3-e766da2ce8cb service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:09.589928 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-223b3d6b-d3d4-4f43-babf-e36d41011a9d req-73552d64-bed6-43de-b7b3-e766da2ce8cb service nova] Creating event network-changed:f4ee3cc3-a516-4b35-8827-b0d6dbf7a1a8 for instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 on hv-cinder-83716 Jun 16 14:56:09.596128 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-223b3d6b-d3d4-4f43-babf-e36d41011a9d req-73552d64-bed6-43de-b7b3-e766da2ce8cb service nova] Acquired lock "compute-rpcapi-router" {{(pid=117444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 14:56:09.603929 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8ea06270-1a59-4d08-84d0-f7f711a3e8c0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:09.605012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8ea06270-1a59-4d08-84d0-f7f711a3e8c0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:09.612886 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8ea06270-1a59-4d08-84d0-f7f711a3e8c0 None None] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:09.616451 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8ea06270-1a59-4d08-84d0-f7f711a3e8c0 None None] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:09.664124 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.compute.rpcapi [None req-8ea06270-1a59-4d08-84d0-f7f711a3e8c0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 14:56:09.674335 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8ea06270-1a59-4d08-84d0-f7f711a3e8c0 None None] Releasing lock "compute-rpcapi-router" {{(pid=117444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 14:56:09.738836 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8ea06270-1a59-4d08-84d0-f7f711a3e8c0 None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.902932 Jun 16 14:56:09.739693 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 31/72] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:56:09.745116 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3262e842-cec9-48c7-aaa0-8ec7ec2eff25 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:09.760124 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3262e842-cec9-48c7-aaa0-8ec7ec2eff25 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:09.774924 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3262e842-cec9-48c7-aaa0-8ec7ec2eff25 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:09.779027 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3262e842-cec9-48c7-aaa0-8ec7ec2eff25 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:09.788732 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3262e842-cec9-48c7-aaa0-8ec7ec2eff25 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:09.789625 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3262e842-cec9-48c7-aaa0-8ec7ec2eff25 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:10.740434 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7e0f9289-f300-43d9-abef-ebe2e838280f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:10.749101 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7e0f9289-f300-43d9-abef-ebe2e838280f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 1.368181 Jun 16 14:56:10.762012 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 42/73] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:09 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:10.762675 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3262e842-cec9-48c7-aaa0-8ec7ec2eff25 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:10.770641 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c12013bd-59b5-4aae-9ec7-8d8b95652be1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:10.771545 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c12013bd-59b5-4aae-9ec7-8d8b95652be1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:10.782042 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c12013bd-59b5-4aae-9ec7-8d8b95652be1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:10.782490 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c12013bd-59b5-4aae-9ec7-8d8b95652be1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:10.785255 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c12013bd-59b5-4aae-9ec7-8d8b95652be1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:10.787408 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c12013bd-59b5-4aae-9ec7-8d8b95652be1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:10.808807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3262e842-cec9-48c7-aaa0-8ec7ec2eff25 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 1.067891 Jun 16 14:56:10.822100 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 32/74] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:09 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:10.840056 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c7721f83-83df-4ca4-acbc-fc8d0cd3d746 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:10.849131 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c7721f83-83df-4ca4-acbc-fc8d0cd3d746 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:10.862563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7721f83-83df-4ca4-acbc-fc8d0cd3d746 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:10.867278 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7721f83-83df-4ca4-acbc-fc8d0cd3d746 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:10.869010 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7721f83-83df-4ca4-acbc-fc8d0cd3d746 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:10.875156 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7721f83-83df-4ca4-acbc-fc8d0cd3d746 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:11.382045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c12013bd-59b5-4aae-9ec7-8d8b95652be1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:11.401043 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c12013bd-59b5-4aae-9ec7-8d8b95652be1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:11.403200 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c12013bd-59b5-4aae-9ec7-8d8b95652be1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:11.405746 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c12013bd-59b5-4aae-9ec7-8d8b95652be1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1340 microversion: 2.20 time: 0.650717 Jun 16 14:56:11.420693 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 43/75] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:10 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1340 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:11.496299 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c7721f83-83df-4ca4-acbc-fc8d0cd3d746 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:11.508106 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c7721f83-83df-4ca4-acbc-fc8d0cd3d746 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.684443 Jun 16 14:56:11.519578 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 33/76] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:10 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:11.755160 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-8f9ee04a-b954-4681-b990-a0b2db465182 req-3a1fe696-7f85-4af6-b5b8-b204af84b9bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "940ece90-bd85-4bf1-9343-5e81198c0e5f", "tag": "d6a6ee13-981d-4dc8-b333-8781a722b480"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:56:11.771490 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5ac580f3-7a72-445f-a8b3-2bc9c5875ea3 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:11.772265 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5ac580f3-7a72-445f-a8b3-2bc9c5875ea3 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:11.776250 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-8f9ee04a-b954-4681-b990-a0b2db465182 req-3a1fe696-7f85-4af6-b5b8-b204af84b9bd service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:11.777232 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-8f9ee04a-b954-4681-b990-a0b2db465182 req-3a1fe696-7f85-4af6-b5b8-b204af84b9bd service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:11.784672 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5ac580f3-7a72-445f-a8b3-2bc9c5875ea3 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:11.785262 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5ac580f3-7a72-445f-a8b3-2bc9c5875ea3 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:11.786154 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5ac580f3-7a72-445f-a8b3-2bc9c5875ea3 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:11.788116 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5ac580f3-7a72-445f-a8b3-2bc9c5875ea3 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:11.836019 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-8f9ee04a-b954-4681-b990-a0b2db465182 req-3a1fe696-7f85-4af6-b5b8-b204af84b9bd service nova] Creating event network-changed:d6a6ee13-981d-4dc8-b333-8781a722b480 for instance 940ece90-bd85-4bf1-9343-5e81198c0e5f on hv-cinder-83716 Jun 16 14:56:11.836594 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-8f9ee04a-b954-4681-b990-a0b2db465182 req-3a1fe696-7f85-4af6-b5b8-b204af84b9bd service nova] Acquired lock "compute-rpcapi-router" {{(pid=117443) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 14:56:11.837777 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-84352c17-3a6b-49dd-b2e8-d3e1161e828a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:11.838228 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-84352c17-3a6b-49dd-b2e8-d3e1161e828a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:11.839023 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-84352c17-3a6b-49dd-b2e8-d3e1161e828a None None] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:11.839453 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-84352c17-3a6b-49dd-b2e8-d3e1161e828a None None] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:11.870282 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.compute.rpcapi [None req-84352c17-3a6b-49dd-b2e8-d3e1161e828a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 14:56:11.871166 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-84352c17-3a6b-49dd-b2e8-d3e1161e828a None None] Releasing lock "compute-rpcapi-router" {{(pid=117443) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 14:56:11.913914 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-84352c17-3a6b-49dd-b2e8-d3e1161e828a None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.354840 Jun 16 14:56:11.916725 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 44/77] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:56:11.924259 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e0249fd7-ce58-43a9-a5f3-54da79cd85c4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:11.932806 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e0249fd7-ce58-43a9-a5f3-54da79cd85c4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:11.946054 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e0249fd7-ce58-43a9-a5f3-54da79cd85c4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:11.946660 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e0249fd7-ce58-43a9-a5f3-54da79cd85c4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:11.948090 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e0249fd7-ce58-43a9-a5f3-54da79cd85c4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:11.949761 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e0249fd7-ce58-43a9-a5f3-54da79cd85c4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:12.237380 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5ac580f3-7a72-445f-a8b3-2bc9c5875ea3 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:12.254943 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5ac580f3-7a72-445f-a8b3-2bc9c5875ea3 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.488812 Jun 16 14:56:12.256569 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 34/78] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:11 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:12.352225 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e0249fd7-ce58-43a9-a5f3-54da79cd85c4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:12.373883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e0249fd7-ce58-43a9-a5f3-54da79cd85c4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.453728 Jun 16 14:56:12.374780 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 45/79] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:11 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:12.432362 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4650e36f-848c-43eb-b1e9-f5de2fc79e25 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:12.432988 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4650e36f-848c-43eb-b1e9-f5de2fc79e25 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:12.442945 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4650e36f-848c-43eb-b1e9-f5de2fc79e25 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:12.444493 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4650e36f-848c-43eb-b1e9-f5de2fc79e25 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:12.445538 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4650e36f-848c-43eb-b1e9-f5de2fc79e25 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:12.447821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4650e36f-848c-43eb-b1e9-f5de2fc79e25 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:12.537964 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-97e5145b-3b36-4ac2-b424-576e22326c21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:12.538692 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-97e5145b-3b36-4ac2-b424-576e22326c21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:12.549955 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-97e5145b-3b36-4ac2-b424-576e22326c21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:12.552574 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-97e5145b-3b36-4ac2-b424-576e22326c21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:12.553952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-97e5145b-3b36-4ac2-b424-576e22326c21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:12.554733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-97e5145b-3b36-4ac2-b424-576e22326c21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:12.941020 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4650e36f-848c-43eb-b1e9-f5de2fc79e25 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:12.944964 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=100 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:12.960047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4650e36f-848c-43eb-b1e9-f5de2fc79e25 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:12.973060 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4650e36f-848c-43eb-b1e9-f5de2fc79e25 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:12.977933 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4650e36f-848c-43eb-b1e9-f5de2fc79e25 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.550019 Jun 16 14:56:13.000028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 35/80] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:12 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:13.039809 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-97e5145b-3b36-4ac2-b424-576e22326c21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:13.048383 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-97e5145b-3b36-4ac2-b424-576e22326c21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.515638 Jun 16 14:56:13.049098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 46/81] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:12 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:13.274004 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a3609336-ecfc-4973-94e4-fcb0425a825d tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:13.274780 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a3609336-ecfc-4973-94e4-fcb0425a825d tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:13.296916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a3609336-ecfc-4973-94e4-fcb0425a825d tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:13.301223 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a3609336-ecfc-4973-94e4-fcb0425a825d tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:13.302720 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a3609336-ecfc-4973-94e4-fcb0425a825d tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:13.303373 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a3609336-ecfc-4973-94e4-fcb0425a825d tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:13.393642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3d31874a-3eeb-458c-81af-20b39489fda8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:13.394258 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-3d31874a-3eeb-458c-81af-20b39489fda8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:13.401007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3d31874a-3eeb-458c-81af-20b39489fda8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:13.401839 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3d31874a-3eeb-458c-81af-20b39489fda8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:13.402854 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3d31874a-3eeb-458c-81af-20b39489fda8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:13.403521 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3d31874a-3eeb-458c-81af-20b39489fda8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:13.525228 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a3609336-ecfc-4973-94e4-fcb0425a825d tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:13.536507 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a3609336-ecfc-4973-94e4-fcb0425a825d tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.266109 Jun 16 14:56:13.537566 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 36/82] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:13 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:13.717314 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3d31874a-3eeb-458c-81af-20b39489fda8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:13.753158 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3d31874a-3eeb-458c-81af-20b39489fda8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.338274 Jun 16 14:56:13.755189 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 47/83] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:13 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:13.954614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-afe458e4-2363-4703-9ed0-68ce74310c80 req-398dc745-5be9-424b-8daf-8bd2ee715926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d2fec0d-b149-4a09-8708-1654b2d88ac0", "tag": "cc40689c-679f-4519-9590-de4741af856a"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:56:13.969136 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-afe458e4-2363-4703-9ed0-68ce74310c80 req-398dc745-5be9-424b-8daf-8bd2ee715926 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:13.971343 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-afe458e4-2363-4703-9ed0-68ce74310c80 req-398dc745-5be9-424b-8daf-8bd2ee715926 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:14.000727 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d8c2082d-8746-41fc-b6c1-b052d81fe4f3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:14.002494 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d8c2082d-8746-41fc-b6c1-b052d81fe4f3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:14.011623 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-afe458e4-2363-4703-9ed0-68ce74310c80 req-398dc745-5be9-424b-8daf-8bd2ee715926 service nova] Creating event network-changed:cc40689c-679f-4519-9590-de4741af856a for instance 7d2fec0d-b149-4a09-8708-1654b2d88ac0 on hv-cinder-83716 Jun 16 14:56:14.017297 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-afe458e4-2363-4703-9ed0-68ce74310c80 req-398dc745-5be9-424b-8daf-8bd2ee715926 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066463 Jun 16 14:56:14.018578 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 37/84] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:56:14.023563 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d8c2082d-8746-41fc-b6c1-b052d81fe4f3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:14.025063 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d8c2082d-8746-41fc-b6c1-b052d81fe4f3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:14.028029 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d8c2082d-8746-41fc-b6c1-b052d81fe4f3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:14.029200 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d8c2082d-8746-41fc-b6c1-b052d81fe4f3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:14.067431 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-19818be0-e62f-403f-833a-b24e40a0240f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:14.068428 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-19818be0-e62f-403f-833a-b24e40a0240f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:14.089894 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-19818be0-e62f-403f-833a-b24e40a0240f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:14.096285 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-19818be0-e62f-403f-833a-b24e40a0240f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:14.097483 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-19818be0-e62f-403f-833a-b24e40a0240f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:14.099166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-19818be0-e62f-403f-833a-b24e40a0240f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:14.361974 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=22 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:14.569331 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d8c2082d-8746-41fc-b6c1-b052d81fe4f3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:14.578836 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d8c2082d-8746-41fc-b6c1-b052d81fe4f3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:14.582009 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d8c2082d-8746-41fc-b6c1-b052d81fe4f3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:14.583324 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d8c2082d-8746-41fc-b6c1-b052d81fe4f3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.586753 Jun 16 14:56:14.585065 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 48/85] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:13 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:56:14.590602 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-312ada82-4372-4269-a0d1-ad398d9656d4 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:14.591403 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-312ada82-4372-4269-a0d1-ad398d9656d4 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:14.599411 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-312ada82-4372-4269-a0d1-ad398d9656d4 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:14.604671 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-312ada82-4372-4269-a0d1-ad398d9656d4 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:14.605502 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-312ada82-4372-4269-a0d1-ad398d9656d4 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:14.606126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-312ada82-4372-4269-a0d1-ad398d9656d4 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:14.632171 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-19818be0-e62f-403f-833a-b24e40a0240f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:14.641506 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-19818be0-e62f-403f-833a-b24e40a0240f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.578961 Jun 16 14:56:14.642087 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 38/86] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:14 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:14.778497 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-55ed7707-ea67-42ac-a61e-4de1ba76d231 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:14.779269 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-55ed7707-ea67-42ac-a61e-4de1ba76d231 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:14.790691 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-55ed7707-ea67-42ac-a61e-4de1ba76d231 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:14.791924 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-55ed7707-ea67-42ac-a61e-4de1ba76d231 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:14.801192 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-55ed7707-ea67-42ac-a61e-4de1ba76d231 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:14.802543 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-55ed7707-ea67-42ac-a61e-4de1ba76d231 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:14.853425 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-312ada82-4372-4269-a0d1-ad398d9656d4 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:14.863523 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-312ada82-4372-4269-a0d1-ad398d9656d4 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.277081 Jun 16 14:56:14.865704 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 49/87] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:14 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:14.988786 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-55ed7707-ea67-42ac-a61e-4de1ba76d231 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:14.998222 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-55ed7707-ea67-42ac-a61e-4de1ba76d231 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.227660 Jun 16 14:56:14.998934 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 39/88] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:14 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:15.603494 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-512f5f76-9f45-443d-8cef-d4512bb5a280 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:15.604777 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-512f5f76-9f45-443d-8cef-d4512bb5a280 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:15.608186 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:15.612503 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=28 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:15.616905 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-512f5f76-9f45-443d-8cef-d4512bb5a280 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:15.617604 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-512f5f76-9f45-443d-8cef-d4512bb5a280 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:15.619096 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-512f5f76-9f45-443d-8cef-d4512bb5a280 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:15.619614 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-512f5f76-9f45-443d-8cef-d4512bb5a280 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:15.660393 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-93e91f6d-590b-4bbb-b5e7-6d8a4b6a7a65 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:15.661833 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-93e91f6d-590b-4bbb-b5e7-6d8a4b6a7a65 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:15.669058 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-93e91f6d-590b-4bbb-b5e7-6d8a4b6a7a65 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:15.669827 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-93e91f6d-590b-4bbb-b5e7-6d8a4b6a7a65 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:15.670823 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-93e91f6d-590b-4bbb-b5e7-6d8a4b6a7a65 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:15.671578 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-93e91f6d-590b-4bbb-b5e7-6d8a4b6a7a65 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:15.868724 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-512f5f76-9f45-443d-8cef-d4512bb5a280 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:15.893343 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-512f5f76-9f45-443d-8cef-d4512bb5a280 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:15.902078 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-512f5f76-9f45-443d-8cef-d4512bb5a280 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:15.904608 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-512f5f76-9f45-443d-8cef-d4512bb5a280 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.305698 Jun 16 14:56:15.906969 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 50/89] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:15 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:15.914264 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8b8ed86c-0984-4523-89d2-692805431a46 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:15.915408 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-8b8ed86c-0984-4523-89d2-692805431a46 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:15.928167 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8b8ed86c-0984-4523-89d2-692805431a46 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:15.929601 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8b8ed86c-0984-4523-89d2-692805431a46 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:15.931836 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8b8ed86c-0984-4523-89d2-692805431a46 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:15.933068 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8b8ed86c-0984-4523-89d2-692805431a46 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:15.937481 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-93e91f6d-590b-4bbb-b5e7-6d8a4b6a7a65 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:15.942962 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=100 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:15.956503 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-93e91f6d-590b-4bbb-b5e7-6d8a4b6a7a65 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.301948 Jun 16 14:56:15.958345 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 40/90] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:15 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:16.015252 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-03bd19ff-acaa-4832-8107-2aca78cdbf74 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:16.016007 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-03bd19ff-acaa-4832-8107-2aca78cdbf74 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:16.022754 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-03bd19ff-acaa-4832-8107-2aca78cdbf74 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:16.023336 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-03bd19ff-acaa-4832-8107-2aca78cdbf74 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:16.024889 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-03bd19ff-acaa-4832-8107-2aca78cdbf74 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:16.026163 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-03bd19ff-acaa-4832-8107-2aca78cdbf74 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:16.160209 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-8b8ed86c-0984-4523-89d2-692805431a46 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:16.170069 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8b8ed86c-0984-4523-89d2-692805431a46 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.259323 Jun 16 14:56:16.170684 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 51/91] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:15 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:16.239060 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-03bd19ff-acaa-4832-8107-2aca78cdbf74 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:16.248040 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-03bd19ff-acaa-4832-8107-2aca78cdbf74 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.236560 Jun 16 14:56:16.248624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 41/92] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:16 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:16.924451 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-56dc0f85-dabd-4649-94af-3fbcdc06c0c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:16.925251 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-56dc0f85-dabd-4649-94af-3fbcdc06c0c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:16.938646 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-56dc0f85-dabd-4649-94af-3fbcdc06c0c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:16.947840 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-56dc0f85-dabd-4649-94af-3fbcdc06c0c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:16.953200 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-56dc0f85-dabd-4649-94af-3fbcdc06c0c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:16.959635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-56dc0f85-dabd-4649-94af-3fbcdc06c0c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:16.986574 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d10d5256-b9df-42f3-958e-29473ee19be9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:16.987476 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d10d5256-b9df-42f3-958e-29473ee19be9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:17.005815 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d10d5256-b9df-42f3-958e-29473ee19be9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:17.006264 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d10d5256-b9df-42f3-958e-29473ee19be9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:17.007044 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d10d5256-b9df-42f3-958e-29473ee19be9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:17.007478 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d10d5256-b9df-42f3-958e-29473ee19be9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:17.589462 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-56dc0f85-dabd-4649-94af-3fbcdc06c0c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:17.617386 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d10d5256-b9df-42f3-958e-29473ee19be9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:17.632862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-56dc0f85-dabd-4649-94af-3fbcdc06c0c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:17.636773 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-56dc0f85-dabd-4649-94af-3fbcdc06c0c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:17.641807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d10d5256-b9df-42f3-958e-29473ee19be9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.660319 Jun 16 14:56:17.642879 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-56dc0f85-dabd-4649-94af-3fbcdc06c0c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.723316 Jun 16 14:56:17.644008 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 42/93] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:16 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:17.648829 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-33de4cf9-746e-4a19-be6d-43b24e20ad4a tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:17.650319 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 52/94] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:16 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:17.670266 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-271d538e-fe9c-47be-9420-f82891c3687b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:17.671978 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-271d538e-fe9c-47be-9420-f82891c3687b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:17.674353 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-33de4cf9-746e-4a19-be6d-43b24e20ad4a tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:17.691366 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-271d538e-fe9c-47be-9420-f82891c3687b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:17.693421 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-271d538e-fe9c-47be-9420-f82891c3687b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:17.694428 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-271d538e-fe9c-47be-9420-f82891c3687b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:17.694584 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-33de4cf9-746e-4a19-be6d-43b24e20ad4a tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:17.695637 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-33de4cf9-746e-4a19-be6d-43b24e20ad4a tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:17.697286 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-33de4cf9-746e-4a19-be6d-43b24e20ad4a tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:17.697457 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-271d538e-fe9c-47be-9420-f82891c3687b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:17.697807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-33de4cf9-746e-4a19-be6d-43b24e20ad4a tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:18.067745 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-271d538e-fe9c-47be-9420-f82891c3687b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:18.078576 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-271d538e-fe9c-47be-9420-f82891c3687b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.422837 Jun 16 14:56:18.079468 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 53/95] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:17 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:18.093144 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-47fb5820-6f98-4728-aa55-d78ea438b618 req-3873ef3f-eb73-4b34-97ce-4217c74dfef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e786be21-8e43-4fdb-9790-7aabbad8a47c", "tag": "0a04f9d9-973f-46a8-a654-59f421e343ef"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:56:18.097471 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-33de4cf9-746e-4a19-be6d-43b24e20ad4a tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:18.115777 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-47fb5820-6f98-4728-aa55-d78ea438b618 req-3873ef3f-eb73-4b34-97ce-4217c74dfef9 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:18.116687 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-47fb5820-6f98-4728-aa55-d78ea438b618 req-3873ef3f-eb73-4b34-97ce-4217c74dfef9 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:18.117965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-33de4cf9-746e-4a19-be6d-43b24e20ad4a tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.472625 Jun 16 14:56:18.119204 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 43/96] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:17 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:18.145838 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-debab833-9107-4974-99bf-1db85abcf914 req-c5451873-2703-4e6c-ac96-bffcff03a615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "663488be-459f-4a58-aa1c-82be04813a2f", "tag": "5508bdf2-993b-44f0-8926-4159b1e31b1d"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:56:18.154753 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-47fb5820-6f98-4728-aa55-d78ea438b618 req-3873ef3f-eb73-4b34-97ce-4217c74dfef9 service nova] Creating event network-changed:0a04f9d9-973f-46a8-a654-59f421e343ef for instance e786be21-8e43-4fdb-9790-7aabbad8a47c on hv-cinder-83716 Jun 16 14:56:18.172043 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-47fb5820-6f98-4728-aa55-d78ea438b618 req-3873ef3f-eb73-4b34-97ce-4217c74dfef9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087890 Jun 16 14:56:18.172934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 54/97] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:56:18.174970 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-debab833-9107-4974-99bf-1db85abcf914 req-c5451873-2703-4e6c-ac96-bffcff03a615 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:18.176495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-debab833-9107-4974-99bf-1db85abcf914 req-c5451873-2703-4e6c-ac96-bffcff03a615 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:18.198962 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-debab833-9107-4974-99bf-1db85abcf914 req-c5451873-2703-4e6c-ac96-bffcff03a615 service nova] Creating event network-changed:5508bdf2-993b-44f0-8926-4159b1e31b1d for instance 663488be-459f-4a58-aa1c-82be04813a2f on hv-cinder-83716 Jun 16 14:56:18.205761 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-debab833-9107-4974-99bf-1db85abcf914 req-c5451873-2703-4e6c-ac96-bffcff03a615 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083515 Jun 16 14:56:18.206388 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 44/98] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:56:18.662323 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-bbf7013e-077c-456c-b926-f8e0526413fb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:18.664052 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-bbf7013e-077c-456c-b926-f8e0526413fb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:18.673341 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bbf7013e-077c-456c-b926-f8e0526413fb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:18.674205 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bbf7013e-077c-456c-b926-f8e0526413fb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:18.675706 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bbf7013e-077c-456c-b926-f8e0526413fb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:18.676244 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bbf7013e-077c-456c-b926-f8e0526413fb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:18.688860 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d602476a-feee-4a19-a31d-fb692b7bd812 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:18.689594 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d602476a-feee-4a19-a31d-fb692b7bd812 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:18.697406 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d602476a-feee-4a19-a31d-fb692b7bd812 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:18.698208 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d602476a-feee-4a19-a31d-fb692b7bd812 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:18.699292 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d602476a-feee-4a19-a31d-fb692b7bd812 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:18.699788 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d602476a-feee-4a19-a31d-fb692b7bd812 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:19.000932 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-bbf7013e-077c-456c-b926-f8e0526413fb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:19.014753 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-bbf7013e-077c-456c-b926-f8e0526413fb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.357772 Jun 16 14:56:19.017139 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 55/99] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:18 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:19.099061 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-282bbc10-09da-4510-bfcd-be4cce848f0c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:19.100461 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-282bbc10-09da-4510-bfcd-be4cce848f0c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:19.105017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d602476a-feee-4a19-a31d-fb692b7bd812 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:19.109643 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-282bbc10-09da-4510-bfcd-be4cce848f0c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:19.110104 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-282bbc10-09da-4510-bfcd-be4cce848f0c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:19.110881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-282bbc10-09da-4510-bfcd-be4cce848f0c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:19.111348 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-282bbc10-09da-4510-bfcd-be4cce848f0c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:19.113149 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d602476a-feee-4a19-a31d-fb692b7bd812 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:19.118890 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d602476a-feee-4a19-a31d-fb692b7bd812 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:19.121531 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d602476a-feee-4a19-a31d-fb692b7bd812 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.445756 Jun 16 14:56:19.122114 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 45/100] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:18 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:19.138281 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7235327c-c389-460b-a08e-518d67181271 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:19.139788 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7235327c-c389-460b-a08e-518d67181271 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:19.146590 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7235327c-c389-460b-a08e-518d67181271 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:19.147487 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7235327c-c389-460b-a08e-518d67181271 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:19.148633 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7235327c-c389-460b-a08e-518d67181271 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:19.149785 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7235327c-c389-460b-a08e-518d67181271 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:19.647644 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=8 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:19.941500 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-282bbc10-09da-4510-bfcd-be4cce848f0c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:19.957284 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-282bbc10-09da-4510-bfcd-be4cce848f0c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.861012 Jun 16 14:56:19.958779 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7235327c-c389-460b-a08e-518d67181271 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:19.959442 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 56/101] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:19 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:19.977328 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7235327c-c389-460b-a08e-518d67181271 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.842438 Jun 16 14:56:19.978239 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 46/102] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:19 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:20.036403 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f2a33bd8-e423-441f-b745-5b6a1ecf34df tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:20.037782 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f2a33bd8-e423-441f-b745-5b6a1ecf34df tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:20.044170 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f2a33bd8-e423-441f-b745-5b6a1ecf34df tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:20.044804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f2a33bd8-e423-441f-b745-5b6a1ecf34df tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:20.045750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f2a33bd8-e423-441f-b745-5b6a1ecf34df tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:20.046328 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f2a33bd8-e423-441f-b745-5b6a1ecf34df tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:20.145081 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4f3283a8-dae6-49a0-901b-569130bf3007 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:20.146080 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4f3283a8-dae6-49a0-901b-569130bf3007 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:20.155101 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4f3283a8-dae6-49a0-901b-569130bf3007 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:20.156073 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4f3283a8-dae6-49a0-901b-569130bf3007 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:20.156960 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4f3283a8-dae6-49a0-901b-569130bf3007 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:20.157519 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4f3283a8-dae6-49a0-901b-569130bf3007 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:20.255237 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f2a33bd8-e423-441f-b745-5b6a1ecf34df tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:20.264849 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f2a33bd8-e423-441f-b745-5b6a1ecf34df tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.234048 Jun 16 14:56:20.265310 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 57/103] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:20 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:20.320534 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4f3283a8-dae6-49a0-901b-569130bf3007 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:20.328765 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4f3283a8-dae6-49a0-901b-569130bf3007 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:20.330825 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4f3283a8-dae6-49a0-901b-569130bf3007 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:20.331960 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4f3283a8-dae6-49a0-901b-569130bf3007 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.193292 Jun 16 14:56:20.332519 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 47/104] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:20 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:56:20.975784 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-96bdcfc9-e0c6-457d-877b-29eb8b08e1cc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:20.976486 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-96bdcfc9-e0c6-457d-877b-29eb8b08e1cc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:20.983051 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-96bdcfc9-e0c6-457d-877b-29eb8b08e1cc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:20.983504 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-96bdcfc9-e0c6-457d-877b-29eb8b08e1cc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:20.984481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-96bdcfc9-e0c6-457d-877b-29eb8b08e1cc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:20.985078 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-96bdcfc9-e0c6-457d-877b-29eb8b08e1cc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:20.997383 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a70392db-85c1-40c8-b045-175753d08a89 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:20.997994 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a70392db-85c1-40c8-b045-175753d08a89 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:21.004353 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a70392db-85c1-40c8-b045-175753d08a89 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:21.005356 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a70392db-85c1-40c8-b045-175753d08a89 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:21.006307 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a70392db-85c1-40c8-b045-175753d08a89 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:21.007107 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a70392db-85c1-40c8-b045-175753d08a89 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:21.248941 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a70392db-85c1-40c8-b045-175753d08a89 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:21.255039 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-96bdcfc9-e0c6-457d-877b-29eb8b08e1cc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:21.258026 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a70392db-85c1-40c8-b045-175753d08a89 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.265867 Jun 16 14:56:21.258603 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 48/105] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:20 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:21.265630 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-96bdcfc9-e0c6-457d-877b-29eb8b08e1cc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.294257 Jun 16 14:56:21.266210 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 58/106] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:20 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:21.283020 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-363fbc78-8b6b-4fcc-a5d7-d477a9f0b6f7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:21.283637 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-363fbc78-8b6b-4fcc-a5d7-d477a9f0b6f7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:21.289976 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-363fbc78-8b6b-4fcc-a5d7-d477a9f0b6f7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:21.290466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-363fbc78-8b6b-4fcc-a5d7-d477a9f0b6f7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:21.291480 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-363fbc78-8b6b-4fcc-a5d7-d477a9f0b6f7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:21.292106 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-363fbc78-8b6b-4fcc-a5d7-d477a9f0b6f7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:21.351285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c7107fed-9df4-4f40-a4e2-59903955595a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:21.352289 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c7107fed-9df4-4f40-a4e2-59903955595a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:21.358600 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c7107fed-9df4-4f40-a4e2-59903955595a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:21.359065 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c7107fed-9df4-4f40-a4e2-59903955595a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:21.359878 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c7107fed-9df4-4f40-a4e2-59903955595a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:21.360312 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c7107fed-9df4-4f40-a4e2-59903955595a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:21.549265 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-363fbc78-8b6b-4fcc-a5d7-d477a9f0b6f7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:21.556949 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-363fbc78-8b6b-4fcc-a5d7-d477a9f0b6f7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.278378 Jun 16 14:56:21.557634 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 49/107] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:21 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:21.600198 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c7107fed-9df4-4f40-a4e2-59903955595a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:21.608210 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c7107fed-9df4-4f40-a4e2-59903955595a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:21.609796 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c7107fed-9df4-4f40-a4e2-59903955595a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:21.611468 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c7107fed-9df4-4f40-a4e2-59903955595a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.264518 Jun 16 14:56:21.612339 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 59/108] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:21 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:56:22.275232 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9fa5e08a-846f-4fbb-9975-7840b1f7336a tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:22.275886 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9fa5e08a-846f-4fbb-9975-7840b1f7336a tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:22.282562 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3b3b8a8c-06d5-49cd-92e1-e5f3fae60311 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:22.283553 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9fa5e08a-846f-4fbb-9975-7840b1f7336a tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:22.283649 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-3b3b8a8c-06d5-49cd-92e1-e5f3fae60311 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:22.283759 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9fa5e08a-846f-4fbb-9975-7840b1f7336a tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:22.284473 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9fa5e08a-846f-4fbb-9975-7840b1f7336a tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:22.284906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9fa5e08a-846f-4fbb-9975-7840b1f7336a tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:22.286594 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=2 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:22.291023 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3b3b8a8c-06d5-49cd-92e1-e5f3fae60311 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:22.291567 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3b3b8a8c-06d5-49cd-92e1-e5f3fae60311 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:22.292376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3b3b8a8c-06d5-49cd-92e1-e5f3fae60311 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:22.292804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3b3b8a8c-06d5-49cd-92e1-e5f3fae60311 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:22.491918 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9fa5e08a-846f-4fbb-9975-7840b1f7336a tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:22.494966 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3b3b8a8c-06d5-49cd-92e1-e5f3fae60311 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:22.500302 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9fa5e08a-846f-4fbb-9975-7840b1f7336a tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.228828 Jun 16 14:56:22.500873 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 50/109] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:22 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:22.512241 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3b3b8a8c-06d5-49cd-92e1-e5f3fae60311 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.233518 Jun 16 14:56:22.512959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 60/110] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:22 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:22.574915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-25438db4-9ff5-40c6-8dc0-b5281a490646 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:22.575529 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-25438db4-9ff5-40c6-8dc0-b5281a490646 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:22.581981 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-25438db4-9ff5-40c6-8dc0-b5281a490646 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:22.582434 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-25438db4-9ff5-40c6-8dc0-b5281a490646 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:22.583238 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-25438db4-9ff5-40c6-8dc0-b5281a490646 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:22.583670 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-25438db4-9ff5-40c6-8dc0-b5281a490646 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:22.629208 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d498664a-2bc7-4b37-b470-173087279f6a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:22.629888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d498664a-2bc7-4b37-b470-173087279f6a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:22.636619 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d498664a-2bc7-4b37-b470-173087279f6a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:22.637152 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d498664a-2bc7-4b37-b470-173087279f6a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:22.637980 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d498664a-2bc7-4b37-b470-173087279f6a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:22.638597 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d498664a-2bc7-4b37-b470-173087279f6a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:22.789097 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-25438db4-9ff5-40c6-8dc0-b5281a490646 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:22.797479 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-25438db4-9ff5-40c6-8dc0-b5281a490646 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.226616 Jun 16 14:56:22.798065 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 51/111] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:22 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:22.823110 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d498664a-2bc7-4b37-b470-173087279f6a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:22.832462 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d498664a-2bc7-4b37-b470-173087279f6a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:22.834186 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d498664a-2bc7-4b37-b470-173087279f6a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:22.835652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d498664a-2bc7-4b37-b470-173087279f6a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.210748 Jun 16 14:56:22.836510 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 61/112] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:22 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:56:23.517332 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2c52c5e5-19a7-4d00-9e03-e28f842009c3 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:23.518038 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2c52c5e5-19a7-4d00-9e03-e28f842009c3 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:23.526386 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2c52c5e5-19a7-4d00-9e03-e28f842009c3 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:23.528118 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2c52c5e5-19a7-4d00-9e03-e28f842009c3 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:23.529300 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2c52c5e5-19a7-4d00-9e03-e28f842009c3 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:23.529545 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-269c00f5-4d37-4b03-bce9-be5647be841b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:23.530139 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-269c00f5-4d37-4b03-bce9-be5647be841b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:23.531457 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2c52c5e5-19a7-4d00-9e03-e28f842009c3 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:23.539140 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-269c00f5-4d37-4b03-bce9-be5647be841b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:23.539593 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-269c00f5-4d37-4b03-bce9-be5647be841b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:23.540550 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-269c00f5-4d37-4b03-bce9-be5647be841b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:23.540977 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-269c00f5-4d37-4b03-bce9-be5647be841b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:24.047114 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2c52c5e5-19a7-4d00-9e03-e28f842009c3 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:24.056649 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2c52c5e5-19a7-4d00-9e03-e28f842009c3 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.543364 Jun 16 14:56:24.066703 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-269c00f5-4d37-4b03-bce9-be5647be841b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:24.067323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 52/113] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:23 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:24.074073 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-269c00f5-4d37-4b03-bce9-be5647be841b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.548326 Jun 16 14:56:24.074470 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6971f100-8886-4459-ad5a-db9cd1beded6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:24.083597 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 62/114] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:23 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:24.083597 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e6756cf6-32bd-481e-b25b-00a554a0b053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:24.083597 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e6756cf6-32bd-481e-b25b-00a554a0b053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:24.085862 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6971f100-8886-4459-ad5a-db9cd1beded6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:24.096669 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e6756cf6-32bd-481e-b25b-00a554a0b053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:24.097146 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e6756cf6-32bd-481e-b25b-00a554a0b053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:24.098968 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6971f100-8886-4459-ad5a-db9cd1beded6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:24.100158 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6971f100-8886-4459-ad5a-db9cd1beded6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:24.101972 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6971f100-8886-4459-ad5a-db9cd1beded6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:24.102527 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6971f100-8886-4459-ad5a-db9cd1beded6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:24.110884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e6756cf6-32bd-481e-b25b-00a554a0b053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:24.111570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e6756cf6-32bd-481e-b25b-00a554a0b053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:24.870047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6971f100-8886-4459-ad5a-db9cd1beded6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:24.873369 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e6756cf6-32bd-481e-b25b-00a554a0b053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:24.879050 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=100 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:24.882658 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6971f100-8886-4459-ad5a-db9cd1beded6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.813995 Jun 16 14:56:24.882807 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e6756cf6-32bd-481e-b25b-00a554a0b053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:24.887730 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e6756cf6-32bd-481e-b25b-00a554a0b053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:24.887944 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 53/115] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:24 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:24.888046 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e6756cf6-32bd-481e-b25b-00a554a0b053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.809336 Jun 16 14:56:24.888046 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 63/116] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:24 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:25.073957 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e61d8c61-4037-4c75-bd51-5b87af6ac4c1 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:25.074564 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e61d8c61-4037-4c75-bd51-5b87af6ac4c1 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:25.080823 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e61d8c61-4037-4c75-bd51-5b87af6ac4c1 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:25.081271 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e61d8c61-4037-4c75-bd51-5b87af6ac4c1 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:25.082032 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e61d8c61-4037-4c75-bd51-5b87af6ac4c1 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:25.082463 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e61d8c61-4037-4c75-bd51-5b87af6ac4c1 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:25.091119 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c8553936-a266-409a-8da3-23fde72a341c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:25.091908 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c8553936-a266-409a-8da3-23fde72a341c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:25.101032 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c8553936-a266-409a-8da3-23fde72a341c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:25.101445 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c8553936-a266-409a-8da3-23fde72a341c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:25.102835 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c8553936-a266-409a-8da3-23fde72a341c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:25.103616 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c8553936-a266-409a-8da3-23fde72a341c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:25.479717 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e61d8c61-4037-4c75-bd51-5b87af6ac4c1 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:25.493302 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e61d8c61-4037-4c75-bd51-5b87af6ac4c1 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.423916 Jun 16 14:56:25.505014 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c8553936-a266-409a-8da3-23fde72a341c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:25.508204 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 54/117] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:25 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:25.527093 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c8553936-a266-409a-8da3-23fde72a341c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.440576 Jun 16 14:56:25.531278 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 64/118] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:25 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:25.902455 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5b909920-6de8-45cb-9c69-7d866a7d1a70 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:25.903076 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5b909920-6de8-45cb-9c69-7d866a7d1a70 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:25.907475 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-43390338-87e7-488e-a76a-062f1b6c6562 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:25.909193 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-43390338-87e7-488e-a76a-062f1b6c6562 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:25.910438 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5b909920-6de8-45cb-9c69-7d866a7d1a70 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:25.910894 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5b909920-6de8-45cb-9c69-7d866a7d1a70 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:25.911758 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5b909920-6de8-45cb-9c69-7d866a7d1a70 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:25.912196 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5b909920-6de8-45cb-9c69-7d866a7d1a70 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:25.920137 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-43390338-87e7-488e-a76a-062f1b6c6562 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:25.920838 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-43390338-87e7-488e-a76a-062f1b6c6562 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:25.921845 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-43390338-87e7-488e-a76a-062f1b6c6562 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:25.922597 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-43390338-87e7-488e-a76a-062f1b6c6562 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:26.162369 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5b909920-6de8-45cb-9c69-7d866a7d1a70 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:26.172245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5b909920-6de8-45cb-9c69-7d866a7d1a70 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.275516 Jun 16 14:56:26.172840 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 55/119] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:25 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:26.176753 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-43390338-87e7-488e-a76a-062f1b6c6562 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:26.189870 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-43390338-87e7-488e-a76a-062f1b6c6562 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:26.193320 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-43390338-87e7-488e-a76a-062f1b6c6562 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:26.194456 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-43390338-87e7-488e-a76a-062f1b6c6562 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.295225 Jun 16 14:56:26.195247 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 65/120] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:25 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:26.518266 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8c3fd75e-4051-4a3e-bacc-84400c645a4b tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:26.520023 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8c3fd75e-4051-4a3e-bacc-84400c645a4b tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:26.530924 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8c3fd75e-4051-4a3e-bacc-84400c645a4b tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:26.531370 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8c3fd75e-4051-4a3e-bacc-84400c645a4b tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:26.532319 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8c3fd75e-4051-4a3e-bacc-84400c645a4b tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:26.533841 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8c3fd75e-4051-4a3e-bacc-84400c645a4b tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:26.550758 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4bdaff25-dc2a-41e5-b13d-170382d084db tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:26.552763 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4bdaff25-dc2a-41e5-b13d-170382d084db tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:26.560480 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4bdaff25-dc2a-41e5-b13d-170382d084db tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:26.561268 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4bdaff25-dc2a-41e5-b13d-170382d084db tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:26.562314 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4bdaff25-dc2a-41e5-b13d-170382d084db tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:26.563794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4bdaff25-dc2a-41e5-b13d-170382d084db tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:26.760049 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8c3fd75e-4051-4a3e-bacc-84400c645a4b tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:26.767815 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8c3fd75e-4051-4a3e-bacc-84400c645a4b tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.256733 Jun 16 14:56:26.769279 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 56/121] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:26 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:26.793101 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4bdaff25-dc2a-41e5-b13d-170382d084db tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:26.805929 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4bdaff25-dc2a-41e5-b13d-170382d084db tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.258636 Jun 16 14:56:26.806527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 66/122] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:26 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:26.915299 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-b2b29652-c675-43a5-b196-e33a520a8974 req-5bb8dbe1-7da3-465e-b46c-6a316f3d7958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb2c36e-f3e4-44bf-bec8-b512d6b0c970", "name": "network-vif-plugged", "status": "completed", "tag": "f4ee3cc3-a516-4b35-8827-b0d6dbf7a1a8"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:56:26.924647 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-b2b29652-c675-43a5-b196-e33a520a8974 req-5bb8dbe1-7da3-465e-b46c-6a316f3d7958 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:26.925303 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-b2b29652-c675-43a5-b196-e33a520a8974 req-5bb8dbe1-7da3-465e-b46c-6a316f3d7958 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:26.944438 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-b2b29652-c675-43a5-b196-e33a520a8974 req-5bb8dbe1-7da3-465e-b46c-6a316f3d7958 service nova] Creating event network-vif-plugged:f4ee3cc3-a516-4b35-8827-b0d6dbf7a1a8 for instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 on hv-cinder-83716 Jun 16 14:56:26.949932 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-b2b29652-c675-43a5-b196-e33a520a8974 req-5bb8dbe1-7da3-465e-b46c-6a316f3d7958 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179371 Jun 16 14:56:26.950533 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 57/123] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:56:27.190507 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ce204411-3660-4d50-bdf5-79d0b4938c6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:27.191203 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ce204411-3660-4d50-bdf5-79d0b4938c6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:27.197755 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ce204411-3660-4d50-bdf5-79d0b4938c6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:27.198199 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ce204411-3660-4d50-bdf5-79d0b4938c6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:27.198957 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ce204411-3660-4d50-bdf5-79d0b4938c6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:27.199381 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ce204411-3660-4d50-bdf5-79d0b4938c6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:27.214345 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f3694d4c-2b0d-4024-9d95-0277144da2e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:27.215070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f3694d4c-2b0d-4024-9d95-0277144da2e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:27.223010 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f3694d4c-2b0d-4024-9d95-0277144da2e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:27.223467 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f3694d4c-2b0d-4024-9d95-0277144da2e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:27.224302 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f3694d4c-2b0d-4024-9d95-0277144da2e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:27.224837 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f3694d4c-2b0d-4024-9d95-0277144da2e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:27.421279 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ce204411-3660-4d50-bdf5-79d0b4938c6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:27.430595 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ce204411-3660-4d50-bdf5-79d0b4938c6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.244418 Jun 16 14:56:27.431364 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f3694d4c-2b0d-4024-9d95-0277144da2e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:27.432281 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 67/124] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:27 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:27.441423 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f3694d4c-2b0d-4024-9d95-0277144da2e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:27.442928 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f3694d4c-2b0d-4024-9d95-0277144da2e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:27.444124 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f3694d4c-2b0d-4024-9d95-0277144da2e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.234746 Jun 16 14:56:27.444677 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 58/125] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:27 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:27.785930 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-42b1778d-aac6-4960-89a7-42f178145b87 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:27.786533 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-42b1778d-aac6-4960-89a7-42f178145b87 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:27.792503 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-42b1778d-aac6-4960-89a7-42f178145b87 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:27.792946 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-42b1778d-aac6-4960-89a7-42f178145b87 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:27.793702 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-42b1778d-aac6-4960-89a7-42f178145b87 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:27.794130 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-42b1778d-aac6-4960-89a7-42f178145b87 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:27.812886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=100 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:27.825152 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a3ee8eb2-38d4-4e2b-a726-556e860373a7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:27.826030 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a3ee8eb2-38d4-4e2b-a726-556e860373a7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:27.832083 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a3ee8eb2-38d4-4e2b-a726-556e860373a7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:27.832530 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a3ee8eb2-38d4-4e2b-a726-556e860373a7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:27.833294 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a3ee8eb2-38d4-4e2b-a726-556e860373a7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:27.833893 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a3ee8eb2-38d4-4e2b-a726-556e860373a7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:27.981211 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-42b1778d-aac6-4960-89a7-42f178145b87 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:27.990257 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-42b1778d-aac6-4960-89a7-42f178145b87 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.207983 Jun 16 14:56:27.992331 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 68/126] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:27 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:28.021375 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a3ee8eb2-38d4-4e2b-a726-556e860373a7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:28.030621 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a3ee8eb2-38d4-4e2b-a726-556e860373a7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.208905 Jun 16 14:56:28.031658 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 59/127] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:27 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:28.448780 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ce857e11-970d-449c-9285-e85b432d87a1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:28.449291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ce857e11-970d-449c-9285-e85b432d87a1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:28.455303 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ce857e11-970d-449c-9285-e85b432d87a1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:28.455771 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ce857e11-970d-449c-9285-e85b432d87a1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:28.456516 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ce857e11-970d-449c-9285-e85b432d87a1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:28.457240 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ce857e11-970d-449c-9285-e85b432d87a1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:28.462687 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-694d8bb7-af65-45a9-8fa7-10f7976c2687 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:28.463304 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-694d8bb7-af65-45a9-8fa7-10f7976c2687 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:28.469197 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-694d8bb7-af65-45a9-8fa7-10f7976c2687 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:28.469650 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-694d8bb7-af65-45a9-8fa7-10f7976c2687 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:28.470446 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-694d8bb7-af65-45a9-8fa7-10f7976c2687 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:28.470886 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-694d8bb7-af65-45a9-8fa7-10f7976c2687 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:28.646988 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ce857e11-970d-449c-9285-e85b432d87a1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:28.654722 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ce857e11-970d-449c-9285-e85b432d87a1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.209829 Jun 16 14:56:28.655557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 69/128] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:28 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:28.658676 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-694d8bb7-af65-45a9-8fa7-10f7976c2687 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:28.667427 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-694d8bb7-af65-45a9-8fa7-10f7976c2687 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:28.669129 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-694d8bb7-af65-45a9-8fa7-10f7976c2687 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:28.670237 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-694d8bb7-af65-45a9-8fa7-10f7976c2687 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.212152 Jun 16 14:56:28.670791 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 60/129] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:28 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:56:29.009695 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-453b1908-2557-491a-946c-51ad5f2bda27 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:29.010951 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-453b1908-2557-491a-946c-51ad5f2bda27 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:29.022021 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-453b1908-2557-491a-946c-51ad5f2bda27 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:29.023086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-453b1908-2557-491a-946c-51ad5f2bda27 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:29.024734 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-453b1908-2557-491a-946c-51ad5f2bda27 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:29.025398 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-453b1908-2557-491a-946c-51ad5f2bda27 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:29.050377 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-33359288-9bb7-478b-a559-0993fa4345df tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:29.052535 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-33359288-9bb7-478b-a559-0993fa4345df tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:29.089327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-33359288-9bb7-478b-a559-0993fa4345df tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:29.094013 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-33359288-9bb7-478b-a559-0993fa4345df tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:29.099316 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-33359288-9bb7-478b-a559-0993fa4345df tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:29.100765 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-33359288-9bb7-478b-a559-0993fa4345df tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:29.604238 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-453b1908-2557-491a-946c-51ad5f2bda27 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:29.614658 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-453b1908-2557-491a-946c-51ad5f2bda27 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.610430 Jun 16 14:56:29.615269 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 70/130] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:29 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:29.637454 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-33359288-9bb7-478b-a559-0993fa4345df tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:29.646891 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-33359288-9bb7-478b-a559-0993fa4345df tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.601921 Jun 16 14:56:29.647614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 61/131] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:29 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:29.673933 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ce349f1e-25d6-4a4c-9250-10acb254a40b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:29.674833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ce349f1e-25d6-4a4c-9250-10acb254a40b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:29.684743 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ce349f1e-25d6-4a4c-9250-10acb254a40b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:29.685402 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ce349f1e-25d6-4a4c-9250-10acb254a40b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:29.687169 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ce349f1e-25d6-4a4c-9250-10acb254a40b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:29.688144 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ce349f1e-25d6-4a4c-9250-10acb254a40b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:29.690008 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-128aeb62-c2fd-4eb9-8786-1a0778a182a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:29.690673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-128aeb62-c2fd-4eb9-8786-1a0778a182a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:29.697351 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-128aeb62-c2fd-4eb9-8786-1a0778a182a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:29.698101 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-128aeb62-c2fd-4eb9-8786-1a0778a182a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:29.699020 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-128aeb62-c2fd-4eb9-8786-1a0778a182a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:29.699599 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-128aeb62-c2fd-4eb9-8786-1a0778a182a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:29.928053 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ce349f1e-25d6-4a4c-9250-10acb254a40b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:29.936140 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ce349f1e-25d6-4a4c-9250-10acb254a40b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.268495 Jun 16 14:56:29.936785 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 71/132] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:29 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:29.946680 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-128aeb62-c2fd-4eb9-8786-1a0778a182a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:29.952795 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-128aeb62-c2fd-4eb9-8786-1a0778a182a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:29.954319 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-128aeb62-c2fd-4eb9-8786-1a0778a182a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:29.955434 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-128aeb62-c2fd-4eb9-8786-1a0778a182a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.270130 Jun 16 14:56:29.956017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 62/133] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:29 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:56:30.630916 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c4517baf-838a-4635-b3a0-713fd7e3802c tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:30.631526 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c4517baf-838a-4635-b3a0-713fd7e3802c tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:30.640444 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c4517baf-838a-4635-b3a0-713fd7e3802c tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:30.640444 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c4517baf-838a-4635-b3a0-713fd7e3802c tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:30.640444 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c4517baf-838a-4635-b3a0-713fd7e3802c tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:30.640444 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c4517baf-838a-4635-b3a0-713fd7e3802c tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:30.665304 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-11f05d13-70ac-4dfa-9b2f-9fa9a2ececc0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:30.665901 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-11f05d13-70ac-4dfa-9b2f-9fa9a2ececc0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:30.672479 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-11f05d13-70ac-4dfa-9b2f-9fa9a2ececc0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:30.673061 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-11f05d13-70ac-4dfa-9b2f-9fa9a2ececc0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:30.673930 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-11f05d13-70ac-4dfa-9b2f-9fa9a2ececc0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:30.674429 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-11f05d13-70ac-4dfa-9b2f-9fa9a2ececc0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:30.841199 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c4517baf-838a-4635-b3a0-713fd7e3802c tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:30.849177 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-11f05d13-70ac-4dfa-9b2f-9fa9a2ececc0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:30.849365 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c4517baf-838a-4635-b3a0-713fd7e3802c tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.222254 Jun 16 14:56:30.849770 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 72/134] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:30 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:30.857197 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-11f05d13-70ac-4dfa-9b2f-9fa9a2ececc0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.196272 Jun 16 14:56:30.857865 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 63/135] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:30 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:30.954375 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8c382f53-986d-42d2-925b-aece1097ad83 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:30.955480 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-8c382f53-986d-42d2-925b-aece1097ad83 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:30.961430 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c382f53-986d-42d2-925b-aece1097ad83 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:30.961875 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c382f53-986d-42d2-925b-aece1097ad83 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:30.962613 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c382f53-986d-42d2-925b-aece1097ad83 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:30.963037 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c382f53-986d-42d2-925b-aece1097ad83 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:30.974278 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-bbb1cfc7-37cf-4391-b345-fbff6a3e4cb0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:30.974877 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-bbb1cfc7-37cf-4391-b345-fbff6a3e4cb0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:30.980763 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bbb1cfc7-37cf-4391-b345-fbff6a3e4cb0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:30.981206 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bbb1cfc7-37cf-4391-b345-fbff6a3e4cb0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:30.981956 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bbb1cfc7-37cf-4391-b345-fbff6a3e4cb0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:30.982379 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bbb1cfc7-37cf-4391-b345-fbff6a3e4cb0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:31.158936 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-8c382f53-986d-42d2-925b-aece1097ad83 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:31.167933 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8c382f53-986d-42d2-925b-aece1097ad83 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.217401 Jun 16 14:56:31.168764 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 73/136] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:30 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:31.171939 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-bbb1cfc7-37cf-4391-b345-fbff6a3e4cb0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:31.181917 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-bbb1cfc7-37cf-4391-b345-fbff6a3e4cb0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:31.183431 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-bbb1cfc7-37cf-4391-b345-fbff6a3e4cb0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:31.184606 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-bbb1cfc7-37cf-4391-b345-fbff6a3e4cb0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.214770 Jun 16 14:56:31.185161 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 64/137] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:30 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:56:31.865314 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6c56eb7b-af72-46b2-ba62-a4be8a2c74e8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:31.865928 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6c56eb7b-af72-46b2-ba62-a4be8a2c74e8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:31.872452 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6c56eb7b-af72-46b2-ba62-a4be8a2c74e8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:31.873158 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6c56eb7b-af72-46b2-ba62-a4be8a2c74e8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:31.873970 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6c56eb7b-af72-46b2-ba62-a4be8a2c74e8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:31.874420 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6c56eb7b-af72-46b2-ba62-a4be8a2c74e8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:31.874626 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7024eefa-860a-49cb-bb9a-a0963ebce461 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:31.875363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7024eefa-860a-49cb-bb9a-a0963ebce461 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:31.882017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7024eefa-860a-49cb-bb9a-a0963ebce461 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:31.882574 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7024eefa-860a-49cb-bb9a-a0963ebce461 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:31.883470 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7024eefa-860a-49cb-bb9a-a0963ebce461 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:31.884029 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7024eefa-860a-49cb-bb9a-a0963ebce461 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:32.078495 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6c56eb7b-af72-46b2-ba62-a4be8a2c74e8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:32.085888 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7024eefa-860a-49cb-bb9a-a0963ebce461 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:32.086576 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6c56eb7b-af72-46b2-ba62-a4be8a2c74e8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.225045 Jun 16 14:56:32.087736 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 74/138] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:31 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:32.093708 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7024eefa-860a-49cb-bb9a-a0963ebce461 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.223489 Jun 16 14:56:32.094271 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 65/139] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:31 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:32.185333 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4a17228d-1cab-447e-88a0-827d5eb451e7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:32.186032 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4a17228d-1cab-447e-88a0-827d5eb451e7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:32.192920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4a17228d-1cab-447e-88a0-827d5eb451e7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:32.193369 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4a17228d-1cab-447e-88a0-827d5eb451e7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:32.194125 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4a17228d-1cab-447e-88a0-827d5eb451e7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:32.194558 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4a17228d-1cab-447e-88a0-827d5eb451e7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:32.202464 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a7b7e119-34fb-466e-bd0e-c0e736c27aa0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:32.203075 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a7b7e119-34fb-466e-bd0e-c0e736c27aa0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:32.209052 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a7b7e119-34fb-466e-bd0e-c0e736c27aa0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:32.209494 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a7b7e119-34fb-466e-bd0e-c0e736c27aa0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:32.210252 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a7b7e119-34fb-466e-bd0e-c0e736c27aa0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:32.210684 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a7b7e119-34fb-466e-bd0e-c0e736c27aa0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:32.377588 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4a17228d-1cab-447e-88a0-827d5eb451e7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:32.385011 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4a17228d-1cab-447e-88a0-827d5eb451e7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.203515 Jun 16 14:56:32.385747 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 75/140] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:32 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:32.398292 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a7b7e119-34fb-466e-bd0e-c0e736c27aa0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:32.406386 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a7b7e119-34fb-466e-bd0e-c0e736c27aa0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:32.407927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a7b7e119-34fb-466e-bd0e-c0e736c27aa0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:32.409057 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a7b7e119-34fb-466e-bd0e-c0e736c27aa0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.210553 Jun 16 14:56:32.409606 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 66/141] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:32 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:56:33.104433 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d3b35f0e-e646-4f87-a786-e1798e1706e5 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:33.105040 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d3b35f0e-e646-4f87-a786-e1798e1706e5 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:33.109809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cbf4a12b-5d58-4edd-bf36-84ee17c47051 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:33.110416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-cbf4a12b-5d58-4edd-bf36-84ee17c47051 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:33.111265 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d3b35f0e-e646-4f87-a786-e1798e1706e5 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:33.111797 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d3b35f0e-e646-4f87-a786-e1798e1706e5 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:33.112671 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d3b35f0e-e646-4f87-a786-e1798e1706e5 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:33.113094 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d3b35f0e-e646-4f87-a786-e1798e1706e5 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:33.118916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cbf4a12b-5d58-4edd-bf36-84ee17c47051 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:33.119727 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cbf4a12b-5d58-4edd-bf36-84ee17c47051 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:33.120717 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cbf4a12b-5d58-4edd-bf36-84ee17c47051 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:33.121166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cbf4a12b-5d58-4edd-bf36-84ee17c47051 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:33.506150 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d3b35f0e-e646-4f87-a786-e1798e1706e5 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:33.509054 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cbf4a12b-5d58-4edd-bf36-84ee17c47051 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:33.514425 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d3b35f0e-e646-4f87-a786-e1798e1706e5 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.414594 Jun 16 14:56:33.514997 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 76/142] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:33 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:33.524330 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-cbf4a12b-5d58-4edd-bf36-84ee17c47051 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.410628 Jun 16 14:56:33.524330 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 67/143] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:33 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:33.524512 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ebbb7c31-9e7d-4835-bd12-1d3fefdef3d2 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:33.524512 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ebbb7c31-9e7d-4835-bd12-1d3fefdef3d2 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:33.524714 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-713f15c1-d794-4ba7-a510-8600747d0363 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:33.524714 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-713f15c1-d794-4ba7-a510-8600747d0363 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:33.527030 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ebbb7c31-9e7d-4835-bd12-1d3fefdef3d2 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:33.527479 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ebbb7c31-9e7d-4835-bd12-1d3fefdef3d2 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:33.528266 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ebbb7c31-9e7d-4835-bd12-1d3fefdef3d2 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:33.528695 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ebbb7c31-9e7d-4835-bd12-1d3fefdef3d2 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:33.529654 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-713f15c1-d794-4ba7-a510-8600747d0363 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:33.530103 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-713f15c1-d794-4ba7-a510-8600747d0363 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:33.531126 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-713f15c1-d794-4ba7-a510-8600747d0363 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:33.531560 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-713f15c1-d794-4ba7-a510-8600747d0363 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:33.728103 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ebbb7c31-9e7d-4835-bd12-1d3fefdef3d2 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:33.734984 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-713f15c1-d794-4ba7-a510-8600747d0363 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:33.736271 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ebbb7c31-9e7d-4835-bd12-1d3fefdef3d2 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.219672 Jun 16 14:56:33.736842 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 77/144] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:33 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:33.743408 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-713f15c1-d794-4ba7-a510-8600747d0363 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:33.744944 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-713f15c1-d794-4ba7-a510-8600747d0363 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:33.746041 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-713f15c1-d794-4ba7-a510-8600747d0363 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.227405 Jun 16 14:56:33.746588 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 68/145] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:33 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:34.534479 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d05a38f6-91bf-443e-a3cb-895c0036f615 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:34.536477 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d05a38f6-91bf-443e-a3cb-895c0036f615 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:34.539123 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a7bdb79e-60b2-40ef-a85a-30e46a4026d8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:34.539835 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a7bdb79e-60b2-40ef-a85a-30e46a4026d8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:34.544355 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d05a38f6-91bf-443e-a3cb-895c0036f615 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:34.544939 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d05a38f6-91bf-443e-a3cb-895c0036f615 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:34.546000 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d05a38f6-91bf-443e-a3cb-895c0036f615 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:34.546175 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a7bdb79e-60b2-40ef-a85a-30e46a4026d8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:34.546610 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a7bdb79e-60b2-40ef-a85a-30e46a4026d8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:34.546738 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d05a38f6-91bf-443e-a3cb-895c0036f615 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:34.547639 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a7bdb79e-60b2-40ef-a85a-30e46a4026d8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:34.548302 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a7bdb79e-60b2-40ef-a85a-30e46a4026d8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:34.795180 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a7bdb79e-60b2-40ef-a85a-30e46a4026d8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:34.804771 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a7bdb79e-60b2-40ef-a85a-30e46a4026d8 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.276483 Jun 16 14:56:34.808913 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d05a38f6-91bf-443e-a3cb-895c0036f615 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:34.812903 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 78/146] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:34 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:34.817245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d05a38f6-91bf-443e-a3cb-895c0036f615 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.287554 Jun 16 14:56:34.817825 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 69/147] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:34 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:34.826822 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-66d5be5b-e3aa-48bb-8c1b-a429ab15383d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:34.826822 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-66d5be5b-e3aa-48bb-8c1b-a429ab15383d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:34.826822 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=90 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:34.827892 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-30d569d0-c245-4f54-8f55-ab57bbeef142 req-efb386dd-2048-49dc-85e2-92b5480885b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940ece90-bd85-4bf1-9343-5e81198c0e5f", "name": "network-vif-plugged", "status": "completed", "tag": "d6a6ee13-981d-4dc8-b333-8781a722b480"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:56:34.831151 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-66d5be5b-e3aa-48bb-8c1b-a429ab15383d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:34.831601 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-66d5be5b-e3aa-48bb-8c1b-a429ab15383d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:34.832389 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-66d5be5b-e3aa-48bb-8c1b-a429ab15383d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:34.832940 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-66d5be5b-e3aa-48bb-8c1b-a429ab15383d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:34.838906 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-30d569d0-c245-4f54-8f55-ab57bbeef142 req-efb386dd-2048-49dc-85e2-92b5480885b6 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:34.839535 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-30d569d0-c245-4f54-8f55-ab57bbeef142 req-efb386dd-2048-49dc-85e2-92b5480885b6 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:34.853268 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-30d569d0-c245-4f54-8f55-ab57bbeef142 req-efb386dd-2048-49dc-85e2-92b5480885b6 service nova] Creating event network-vif-plugged:d6a6ee13-981d-4dc8-b333-8781a722b480 for instance 940ece90-bd85-4bf1-9343-5e81198c0e5f on hv-cinder-83716 Jun 16 14:56:34.858718 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-30d569d0-c245-4f54-8f55-ab57bbeef142 req-efb386dd-2048-49dc-85e2-92b5480885b6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044403 Jun 16 14:56:34.859845 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 79/148] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:56:34.870791 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-977588b4-f85d-435e-9505-6283d77350c7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:34.871951 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-977588b4-f85d-435e-9505-6283d77350c7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:34.879484 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-977588b4-f85d-435e-9505-6283d77350c7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:34.880054 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-977588b4-f85d-435e-9505-6283d77350c7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:34.881094 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-977588b4-f85d-435e-9505-6283d77350c7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:34.881632 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-977588b4-f85d-435e-9505-6283d77350c7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:35.062180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-66d5be5b-e3aa-48bb-8c1b-a429ab15383d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:35.073210 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-66d5be5b-e3aa-48bb-8c1b-a429ab15383d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.254355 Jun 16 14:56:35.085968 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 70/149] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:34 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:35.089302 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-977588b4-f85d-435e-9505-6283d77350c7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:35.098203 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-977588b4-f85d-435e-9505-6283d77350c7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:35.099696 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-977588b4-f85d-435e-9505-6283d77350c7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:35.101283 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-977588b4-f85d-435e-9505-6283d77350c7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.234869 Jun 16 14:56:35.102053 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 80/150] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:34 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:35.830125 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2bbc3c13-5736-40fd-a253-e16cc5d892b1 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:35.830818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2bbc3c13-5736-40fd-a253-e16cc5d892b1 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:35.835999 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-fdaeb7a3-a534-4f41-95dc-5b0c45ba105e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:35.836933 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-fdaeb7a3-a534-4f41-95dc-5b0c45ba105e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:35.837118 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2bbc3c13-5736-40fd-a253-e16cc5d892b1 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:35.837566 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2bbc3c13-5736-40fd-a253-e16cc5d892b1 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:35.838991 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2bbc3c13-5736-40fd-a253-e16cc5d892b1 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:35.839571 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2bbc3c13-5736-40fd-a253-e16cc5d892b1 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:35.843925 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=100 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:35.844559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fdaeb7a3-a534-4f41-95dc-5b0c45ba105e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:35.845483 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fdaeb7a3-a534-4f41-95dc-5b0c45ba105e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:35.846491 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fdaeb7a3-a534-4f41-95dc-5b0c45ba105e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:35.847214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fdaeb7a3-a534-4f41-95dc-5b0c45ba105e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:36.048104 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2bbc3c13-5736-40fd-a253-e16cc5d892b1 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:36.050838 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fdaeb7a3-a534-4f41-95dc-5b0c45ba105e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:36.058605 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-fdaeb7a3-a534-4f41-95dc-5b0c45ba105e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.227455 Jun 16 14:56:36.060580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 81/151] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:35 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:36.065229 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2bbc3c13-5736-40fd-a253-e16cc5d892b1 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.239536 Jun 16 14:56:36.065894 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 71/152] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:35 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:36.093097 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8efad17b-d3e2-4bba-8b09-2ca8a183185b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:36.093722 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-8efad17b-d3e2-4bba-8b09-2ca8a183185b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:36.101248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8efad17b-d3e2-4bba-8b09-2ca8a183185b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:36.102062 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8efad17b-d3e2-4bba-8b09-2ca8a183185b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:36.103465 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8efad17b-d3e2-4bba-8b09-2ca8a183185b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:36.104177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8efad17b-d3e2-4bba-8b09-2ca8a183185b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:36.123454 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-12698095-7013-4870-a2e8-b7237000c14e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:36.124192 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-12698095-7013-4870-a2e8-b7237000c14e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:36.134831 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-12698095-7013-4870-a2e8-b7237000c14e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:36.135849 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-12698095-7013-4870-a2e8-b7237000c14e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:36.137025 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-12698095-7013-4870-a2e8-b7237000c14e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:36.137780 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-12698095-7013-4870-a2e8-b7237000c14e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:36.370145 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-12698095-7013-4870-a2e8-b7237000c14e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:36.381709 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-12698095-7013-4870-a2e8-b7237000c14e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:36.383108 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-8efad17b-d3e2-4bba-8b09-2ca8a183185b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:36.383284 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-12698095-7013-4870-a2e8-b7237000c14e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:36.384766 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-12698095-7013-4870-a2e8-b7237000c14e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.265946 Jun 16 14:56:36.397484 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 72/153] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:36 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:56:36.402736 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8efad17b-d3e2-4bba-8b09-2ca8a183185b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.313340 Jun 16 14:56:36.403313 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 82/154] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:36 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:36.875098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-38cf9977-6a43-457b-8e3b-e4e7b0c5b787 req-4520f602-80d9-4e69-96af-c0ba7deb8f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663488be-459f-4a58-aa1c-82be04813a2f", "name": "network-vif-plugged", "status": "completed", "tag": "5508bdf2-993b-44f0-8926-4159b1e31b1d"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:56:36.883022 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-38cf9977-6a43-457b-8e3b-e4e7b0c5b787 req-4520f602-80d9-4e69-96af-c0ba7deb8f0c service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:36.883506 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-38cf9977-6a43-457b-8e3b-e4e7b0c5b787 req-4520f602-80d9-4e69-96af-c0ba7deb8f0c service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:36.895795 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-38cf9977-6a43-457b-8e3b-e4e7b0c5b787 req-4520f602-80d9-4e69-96af-c0ba7deb8f0c service nova] Creating event network-vif-plugged:5508bdf2-993b-44f0-8926-4159b1e31b1d for instance 663488be-459f-4a58-aa1c-82be04813a2f on hv-cinder-83716 Jun 16 14:56:36.901418 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-38cf9977-6a43-457b-8e3b-e4e7b0c5b787 req-4520f602-80d9-4e69-96af-c0ba7deb8f0c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029811 Jun 16 14:56:36.902162 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 73/155] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:56:37.076562 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-0bbc4ca3-f5cd-4725-9b35-cfa6436160f7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:37.077167 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-0bbc4ca3-f5cd-4725-9b35-cfa6436160f7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:37.083907 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0bbc4ca3-f5cd-4725-9b35-cfa6436160f7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:37.084397 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0bbc4ca3-f5cd-4725-9b35-cfa6436160f7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:37.085073 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0bbc4ca3-f5cd-4725-9b35-cfa6436160f7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:37.085494 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0bbc4ca3-f5cd-4725-9b35-cfa6436160f7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:37.085601 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8ea96e1e-7054-428d-959f-04e44afca593 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:37.086368 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8ea96e1e-7054-428d-959f-04e44afca593 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:37.093846 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8ea96e1e-7054-428d-959f-04e44afca593 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:37.094531 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8ea96e1e-7054-428d-959f-04e44afca593 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:37.095375 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8ea96e1e-7054-428d-959f-04e44afca593 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:37.096040 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8ea96e1e-7054-428d-959f-04e44afca593 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:37.304111 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-0bbc4ca3-f5cd-4725-9b35-cfa6436160f7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:37.311594 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8ea96e1e-7054-428d-959f-04e44afca593 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:37.312744 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-0bbc4ca3-f5cd-4725-9b35-cfa6436160f7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.239882 Jun 16 14:56:37.320839 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8ea96e1e-7054-428d-959f-04e44afca593 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.239759 Jun 16 14:56:37.324099 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 74/156] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:37 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:37.326718 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 83/157] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:37 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:37.404083 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-76d1f072-c6e3-4d6f-b054-14284d6a775e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:37.404690 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-76d1f072-c6e3-4d6f-b054-14284d6a775e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:37.411411 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-76d1f072-c6e3-4d6f-b054-14284d6a775e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:37.412097 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-76d1f072-c6e3-4d6f-b054-14284d6a775e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:37.412599 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-76d1f072-c6e3-4d6f-b054-14284d6a775e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:37.413028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-76d1f072-c6e3-4d6f-b054-14284d6a775e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:37.427054 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-477a3073-462a-405f-ba36-a69d94d66e6f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:37.427699 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-477a3073-462a-405f-ba36-a69d94d66e6f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:37.437301 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-477a3073-462a-405f-ba36-a69d94d66e6f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:37.437760 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-477a3073-462a-405f-ba36-a69d94d66e6f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:37.439404 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-477a3073-462a-405f-ba36-a69d94d66e6f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:37.440009 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-477a3073-462a-405f-ba36-a69d94d66e6f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:37.665123 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-76d1f072-c6e3-4d6f-b054-14284d6a775e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:37.679170 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-76d1f072-c6e3-4d6f-b054-14284d6a775e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:37.680859 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-76d1f072-c6e3-4d6f-b054-14284d6a775e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:37.684056 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-477a3073-462a-405f-ba36-a69d94d66e6f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:37.692137 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-477a3073-462a-405f-ba36-a69d94d66e6f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.274795 Jun 16 14:56:37.692640 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 84/158] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:37 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:37.693406 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-76d1f072-c6e3-4d6f-b054-14284d6a775e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.293450 Jun 16 14:56:37.697849 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 75/159] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:37 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:38.333975 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7b7a0ab2-ad0c-4e24-ab5a-a2d88a15b23b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:38.335925 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7b7a0ab2-ad0c-4e24-ab5a-a2d88a15b23b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:38.341065 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7b7a0ab2-ad0c-4e24-ab5a-a2d88a15b23b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:38.341236 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0204a062-9e8b-44c5-b17e-3b25e88860cd tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:38.341632 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7b7a0ab2-ad0c-4e24-ab5a-a2d88a15b23b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:38.341750 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0204a062-9e8b-44c5-b17e-3b25e88860cd tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:38.342561 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7b7a0ab2-ad0c-4e24-ab5a-a2d88a15b23b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:38.343094 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7b7a0ab2-ad0c-4e24-ab5a-a2d88a15b23b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:38.348876 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0204a062-9e8b-44c5-b17e-3b25e88860cd tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:38.349327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0204a062-9e8b-44c5-b17e-3b25e88860cd tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:38.350102 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0204a062-9e8b-44c5-b17e-3b25e88860cd tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:38.350569 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0204a062-9e8b-44c5-b17e-3b25e88860cd tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:38.550664 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7b7a0ab2-ad0c-4e24-ab5a-a2d88a15b23b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:38.555426 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=100 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:38.562459 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7b7a0ab2-ad0c-4e24-ab5a-a2d88a15b23b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.233420 Jun 16 14:56:38.563148 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 85/160] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:38 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:38.566432 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0204a062-9e8b-44c5-b17e-3b25e88860cd tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:38.576158 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0204a062-9e8b-44c5-b17e-3b25e88860cd tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.239269 Jun 16 14:56:38.576863 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 76/161] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:38 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:38.711300 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3bf7856c-080b-4376-b1fb-5861b2a1975b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:38.712249 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-3bf7856c-080b-4376-b1fb-5861b2a1975b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:38.714790 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f967b2ff-fbfe-43cc-af8d-2f019418aa42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:38.715606 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f967b2ff-fbfe-43cc-af8d-2f019418aa42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:38.719246 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3bf7856c-080b-4376-b1fb-5861b2a1975b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:38.720572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3bf7856c-080b-4376-b1fb-5861b2a1975b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:38.721722 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3bf7856c-080b-4376-b1fb-5861b2a1975b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:38.722371 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3bf7856c-080b-4376-b1fb-5861b2a1975b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:38.724517 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f967b2ff-fbfe-43cc-af8d-2f019418aa42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:38.725102 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f967b2ff-fbfe-43cc-af8d-2f019418aa42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:38.726126 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f967b2ff-fbfe-43cc-af8d-2f019418aa42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:38.726794 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f967b2ff-fbfe-43cc-af8d-2f019418aa42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:38.951563 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3bf7856c-080b-4376-b1fb-5861b2a1975b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:38.963148 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f967b2ff-fbfe-43cc-af8d-2f019418aa42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:38.963880 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3bf7856c-080b-4376-b1fb-5861b2a1975b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1367 microversion: 2.1 time: 0.257096 Jun 16 14:56:38.965388 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 86/162] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:38 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:38.973393 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f967b2ff-fbfe-43cc-af8d-2f019418aa42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:38.975697 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f967b2ff-fbfe-43cc-af8d-2f019418aa42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:38.977169 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f967b2ff-fbfe-43cc-af8d-2f019418aa42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.266451 Jun 16 14:56:38.977574 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 77/163] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:38 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:56:39.579977 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-5cf8c766-91dc-45b1-b129-b5ce98d3a290 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:39.580611 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-5cf8c766-91dc-45b1-b129-b5ce98d3a290 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:39.587176 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5cf8c766-91dc-45b1-b129-b5ce98d3a290 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:39.587619 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5cf8c766-91dc-45b1-b129-b5ce98d3a290 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:39.588423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5cf8c766-91dc-45b1-b129-b5ce98d3a290 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:39.588853 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5cf8c766-91dc-45b1-b129-b5ce98d3a290 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:39.593291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-721bc16a-b481-4a3e-a59d-83af8fc0120f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:39.593954 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-721bc16a-b481-4a3e-a59d-83af8fc0120f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:39.600294 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-721bc16a-b481-4a3e-a59d-83af8fc0120f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:39.600746 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-721bc16a-b481-4a3e-a59d-83af8fc0120f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:39.601515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-721bc16a-b481-4a3e-a59d-83af8fc0120f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:39.601956 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-721bc16a-b481-4a3e-a59d-83af8fc0120f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:39.789040 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-5cf8c766-91dc-45b1-b129-b5ce98d3a290 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:39.794113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-721bc16a-b481-4a3e-a59d-83af8fc0120f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:39.797188 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-5cf8c766-91dc-45b1-b129-b5ce98d3a290 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.221073 Jun 16 14:56:39.797961 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 87/164] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:39 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:39.802182 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-721bc16a-b481-4a3e-a59d-83af8fc0120f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.212878 Jun 16 14:56:39.802737 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 78/165] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:39 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:39.980998 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-aa07a57a-e7a1-41b8-b9af-2a42fe65bf49 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:39.981597 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-aa07a57a-e7a1-41b8-b9af-2a42fe65bf49 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:39.988188 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aa07a57a-e7a1-41b8-b9af-2a42fe65bf49 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:39.988629 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aa07a57a-e7a1-41b8-b9af-2a42fe65bf49 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:39.989601 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aa07a57a-e7a1-41b8-b9af-2a42fe65bf49 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:39.990256 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aa07a57a-e7a1-41b8-b9af-2a42fe65bf49 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:39.995269 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f73b812c-349c-4d5f-928b-50aaac715d4d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:39.996202 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f73b812c-349c-4d5f-928b-50aaac715d4d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:40.002974 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f73b812c-349c-4d5f-928b-50aaac715d4d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:40.003658 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f73b812c-349c-4d5f-928b-50aaac715d4d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:40.004449 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f73b812c-349c-4d5f-928b-50aaac715d4d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:40.004883 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f73b812c-349c-4d5f-928b-50aaac715d4d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:40.238951 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-aa07a57a-e7a1-41b8-b9af-2a42fe65bf49 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:40.253846 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-aa07a57a-e7a1-41b8-b9af-2a42fe65bf49 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1556 microversion: 2.1 time: 0.276700 Jun 16 14:56:40.255113 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 88/166] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:39 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1556 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:40.260143 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f73b812c-349c-4d5f-928b-50aaac715d4d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:40.272218 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f73b812c-349c-4d5f-928b-50aaac715d4d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:40.274496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f73b812c-349c-4d5f-928b-50aaac715d4d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:40.275941 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f73b812c-349c-4d5f-928b-50aaac715d4d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.285144 Jun 16 14:56:40.276724 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 79/167] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:39 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:40.287496 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-24f7a340-2fb5-4bea-a698-0518282a32c5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:40.288100 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-24f7a340-2fb5-4bea-a698-0518282a32c5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:40.294940 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-24f7a340-2fb5-4bea-a698-0518282a32c5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:40.295573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-24f7a340-2fb5-4bea-a698-0518282a32c5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:40.296512 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-24f7a340-2fb5-4bea-a698-0518282a32c5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:40.297241 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-24f7a340-2fb5-4bea-a698-0518282a32c5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:40.447882 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-24f7a340-2fb5-4bea-a698-0518282a32c5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.178894 Jun 16 14:56:40.448497 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 89/168] 10.222.0.76 () {58 vars in 1274 bytes} [Thu Jun 16 14:56:40 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:56:40.815115 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-11357f8e-4850-441a-a8fa-e2c6fb3d8785 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:40.816350 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-11357f8e-4850-441a-a8fa-e2c6fb3d8785 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:40.819325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d9d42d83-47fe-4c9e-9027-e00ec24782e0 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:40.819905 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d9d42d83-47fe-4c9e-9027-e00ec24782e0 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:40.823666 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-11357f8e-4850-441a-a8fa-e2c6fb3d8785 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:40.824322 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-11357f8e-4850-441a-a8fa-e2c6fb3d8785 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:40.825229 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-11357f8e-4850-441a-a8fa-e2c6fb3d8785 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:40.825802 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-11357f8e-4850-441a-a8fa-e2c6fb3d8785 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:40.826240 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d9d42d83-47fe-4c9e-9027-e00ec24782e0 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:40.826725 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d9d42d83-47fe-4c9e-9027-e00ec24782e0 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:40.827587 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d9d42d83-47fe-4c9e-9027-e00ec24782e0 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:40.828050 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d9d42d83-47fe-4c9e-9027-e00ec24782e0 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:41.502216 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-11357f8e-4850-441a-a8fa-e2c6fb3d8785 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:41.515842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-11357f8e-4850-441a-a8fa-e2c6fb3d8785 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.704964 Jun 16 14:56:41.526587 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 80/169] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:40 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:41.533029 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-51dad857-c891-40e0-ab25-0a806365e4a0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:41.533779 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d9d42d83-47fe-4c9e-9027-e00ec24782e0 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:41.534226 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-51dad857-c891-40e0-ab25-0a806365e4a0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:41.542750 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-51dad857-c891-40e0-ab25-0a806365e4a0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:41.543955 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-51dad857-c891-40e0-ab25-0a806365e4a0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:41.544903 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-51dad857-c891-40e0-ab25-0a806365e4a0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:41.545708 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-51dad857-c891-40e0-ab25-0a806365e4a0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:41.565237 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d9d42d83-47fe-4c9e-9027-e00ec24782e0 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.748566 Jun 16 14:56:41.566570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 90/170] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:40 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:41.825950 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-51dad857-c891-40e0-ab25-0a806365e4a0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:41.837848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-51dad857-c891-40e0-ab25-0a806365e4a0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:41.839940 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-51dad857-c891-40e0-ab25-0a806365e4a0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:41.841422 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-51dad857-c891-40e0-ab25-0a806365e4a0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.313412 Jun 16 14:56:41.841978 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 81/171] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:41 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:42.253349 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-f1f1a4e6-9050-4f27-9e01-3bb621d608c0 req-21b86f85-171e-48af-b4fe-5d6fe78b404c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb2c36e-f3e4-44bf-bec8-b512d6b0c970", "tag": "f4ee3cc3-a516-4b35-8827-b0d6dbf7a1a8"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:56:42.290269 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-f1f1a4e6-9050-4f27-9e01-3bb621d608c0 req-21b86f85-171e-48af-b4fe-5d6fe78b404c service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:42.292366 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-f1f1a4e6-9050-4f27-9e01-3bb621d608c0 req-21b86f85-171e-48af-b4fe-5d6fe78b404c service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:42.317168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-f1f1a4e6-9050-4f27-9e01-3bb621d608c0 req-21b86f85-171e-48af-b4fe-5d6fe78b404c service nova] Creating event network-changed:f4ee3cc3-a516-4b35-8827-b0d6dbf7a1a8 for instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 on hv-cinder-83716 Jun 16 14:56:42.324545 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-f1f1a4e6-9050-4f27-9e01-3bb621d608c0 req-21b86f85-171e-48af-b4fe-5d6fe78b404c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078164 Jun 16 14:56:42.326803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 91/172] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:56:42.535270 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f62e5470-0bd2-4f5b-ba2b-cd853b12cd2c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:42.536782 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f62e5470-0bd2-4f5b-ba2b-cd853b12cd2c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:42.553422 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f62e5470-0bd2-4f5b-ba2b-cd853b12cd2c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:42.554729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f62e5470-0bd2-4f5b-ba2b-cd853b12cd2c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:42.559138 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f62e5470-0bd2-4f5b-ba2b-cd853b12cd2c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:42.560060 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f62e5470-0bd2-4f5b-ba2b-cd853b12cd2c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:42.584223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-5cb46f00-ccff-44e9-80df-a28c87927c4f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:42.584915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-5cb46f00-ccff-44e9-80df-a28c87927c4f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:42.610894 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5cb46f00-ccff-44e9-80df-a28c87927c4f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:42.612239 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5cb46f00-ccff-44e9-80df-a28c87927c4f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:42.615150 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5cb46f00-ccff-44e9-80df-a28c87927c4f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:42.616165 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5cb46f00-ccff-44e9-80df-a28c87927c4f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:43.206556 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-5cb46f00-ccff-44e9-80df-a28c87927c4f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:43.217041 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-5cb46f00-ccff-44e9-80df-a28c87927c4f tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1314 microversion: 2.1 time: 0.638173 Jun 16 14:56:43.217617 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 92/173] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:42 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:43.232073 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-fb7df88b-ab28-4998-8580-e5985fac7ef5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:43.232771 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-fb7df88b-ab28-4998-8580-e5985fac7ef5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:43.237885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f62e5470-0bd2-4f5b-ba2b-cd853b12cd2c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:43.241189 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fb7df88b-ab28-4998-8580-e5985fac7ef5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:43.241637 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fb7df88b-ab28-4998-8580-e5985fac7ef5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:43.242488 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fb7df88b-ab28-4998-8580-e5985fac7ef5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:43.242818 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fb7df88b-ab28-4998-8580-e5985fac7ef5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:43.250000 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f62e5470-0bd2-4f5b-ba2b-cd853b12cd2c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.719972 Jun 16 14:56:43.251629 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 82/174] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:42 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:43.270022 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-be56debd-a0e6-4c52-a6bc-6ec91489ca2f req-5e5548cd-1475-49a0-a88a-f4fd84515c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2fec0d-b149-4a09-8708-1654b2d88ac0", "name": "network-vif-plugged", "status": "completed", "tag": "cc40689c-679f-4519-9590-de4741af856a"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:56:43.280286 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-be56debd-a0e6-4c52-a6bc-6ec91489ca2f req-5e5548cd-1475-49a0-a88a-f4fd84515c7f service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:43.281422 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-be56debd-a0e6-4c52-a6bc-6ec91489ca2f req-5e5548cd-1475-49a0-a88a-f4fd84515c7f service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:43.297235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-be56debd-a0e6-4c52-a6bc-6ec91489ca2f req-5e5548cd-1475-49a0-a88a-f4fd84515c7f service nova] Creating event network-vif-plugged:cc40689c-679f-4519-9590-de4741af856a for instance 7d2fec0d-b149-4a09-8708-1654b2d88ac0 on hv-cinder-83716 Jun 16 14:56:43.303937 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-be56debd-a0e6-4c52-a6bc-6ec91489ca2f req-5e5548cd-1475-49a0-a88a-f4fd84515c7f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041109 Jun 16 14:56:43.304946 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 83/175] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:56:43.851339 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fb7df88b-ab28-4998-8580-e5985fac7ef5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:43.863950 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fb7df88b-ab28-4998-8580-e5985fac7ef5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:43.875184 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fb7df88b-ab28-4998-8580-e5985fac7ef5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:43.881021 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-fb7df88b-ab28-4998-8580-e5985fac7ef5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.652790 Jun 16 14:56:43.890372 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 93/176] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:43 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:44.243059 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a9833813-7d9c-42b4-8faf-942f6bf91341 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:44.244068 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a9833813-7d9c-42b4-8faf-942f6bf91341 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:44.269896 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b5fa8abb-482c-4bbe-a711-77c279991bf3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:44.272001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b5fa8abb-482c-4bbe-a711-77c279991bf3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:44.277999 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a9833813-7d9c-42b4-8faf-942f6bf91341 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:44.278576 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a9833813-7d9c-42b4-8faf-942f6bf91341 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:44.279413 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a9833813-7d9c-42b4-8faf-942f6bf91341 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:44.279912 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a9833813-7d9c-42b4-8faf-942f6bf91341 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:44.296938 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b5fa8abb-482c-4bbe-a711-77c279991bf3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:44.301512 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b5fa8abb-482c-4bbe-a711-77c279991bf3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:44.302347 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b5fa8abb-482c-4bbe-a711-77c279991bf3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:44.302785 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b5fa8abb-482c-4bbe-a711-77c279991bf3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:45.026899 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b5fa8abb-482c-4bbe-a711-77c279991bf3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:45.036893 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b5fa8abb-482c-4bbe-a711-77c279991bf3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.772181 Jun 16 14:56:45.037472 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 94/177] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:44 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:45.046402 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a9833813-7d9c-42b4-8faf-942f6bf91341 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:45.046688 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-9783d6ba-f433-4bd2-8905-14179c8711b7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:45.046803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-9783d6ba-f433-4bd2-8905-14179c8711b7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:45.054485 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9783d6ba-f433-4bd2-8905-14179c8711b7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:45.055008 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9783d6ba-f433-4bd2-8905-14179c8711b7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:45.055857 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9783d6ba-f433-4bd2-8905-14179c8711b7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:45.056301 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9783d6ba-f433-4bd2-8905-14179c8711b7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:45.058403 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a9833813-7d9c-42b4-8faf-942f6bf91341 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1501 microversion: 2.1 time: 0.821279 Jun 16 14:56:45.059870 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 84/178] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:44 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1501 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:45.237634 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-9783d6ba-f433-4bd2-8905-14179c8711b7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:45.248789 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-9783d6ba-f433-4bd2-8905-14179c8711b7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:45.250853 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-9783d6ba-f433-4bd2-8905-14179c8711b7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:45.252816 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-9783d6ba-f433-4bd2-8905-14179c8711b7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.210558 Jun 16 14:56:45.253485 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 95/179] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:45 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:45.335294 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-f8bad386-1e03-4c95-a9a7-3c4ff0b1325e req-87a1dfdd-b1ef-4528-ac53-0e384e468b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e786be21-8e43-4fdb-9790-7aabbad8a47c", "name": "network-vif-plugged", "status": "completed", "tag": "0a04f9d9-973f-46a8-a654-59f421e343ef"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:56:45.346148 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-f8bad386-1e03-4c95-a9a7-3c4ff0b1325e req-87a1dfdd-b1ef-4528-ac53-0e384e468b1e service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:45.346591 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-f8bad386-1e03-4c95-a9a7-3c4ff0b1325e req-87a1dfdd-b1ef-4528-ac53-0e384e468b1e service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:45.364384 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-f8bad386-1e03-4c95-a9a7-3c4ff0b1325e req-87a1dfdd-b1ef-4528-ac53-0e384e468b1e service nova] Creating event network-vif-plugged:0a04f9d9-973f-46a8-a654-59f421e343ef for instance e786be21-8e43-4fdb-9790-7aabbad8a47c on hv-cinder-83716 Jun 16 14:56:45.369778 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-f8bad386-1e03-4c95-a9a7-3c4ff0b1325e req-87a1dfdd-b1ef-4528-ac53-0e384e468b1e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038903 Jun 16 14:56:45.370904 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 85/180] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:56:46.054428 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4fdf164d-5839-40d5-bf95-1e545fa71010 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:46.055040 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4fdf164d-5839-40d5-bf95-1e545fa71010 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:46.058088 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=91 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:46.062165 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4fdf164d-5839-40d5-bf95-1e545fa71010 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:46.062610 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4fdf164d-5839-40d5-bf95-1e545fa71010 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:46.063407 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4fdf164d-5839-40d5-bf95-1e545fa71010 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:46.064643 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4fdf164d-5839-40d5-bf95-1e545fa71010 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:46.210841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4fdf164d-5839-40d5-bf95-1e545fa71010 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:46.218486 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4fdf164d-5839-40d5-bf95-1e545fa71010 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.168348 Jun 16 14:56:46.223718 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 96/181] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:46 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:46.271635 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d0a2360b-bb19-4e44-9b90-5675be635ae3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:46.272813 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d0a2360b-bb19-4e44-9b90-5675be635ae3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:46.280750 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d0a2360b-bb19-4e44-9b90-5675be635ae3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:46.281168 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d0a2360b-bb19-4e44-9b90-5675be635ae3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:46.281969 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d0a2360b-bb19-4e44-9b90-5675be635ae3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:46.282604 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d0a2360b-bb19-4e44-9b90-5675be635ae3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:46.455064 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d0a2360b-bb19-4e44-9b90-5675be635ae3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:46.465311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d0a2360b-bb19-4e44-9b90-5675be635ae3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:46.466857 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d0a2360b-bb19-4e44-9b90-5675be635ae3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:46.468008 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d0a2360b-bb19-4e44-9b90-5675be635ae3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.200690 Jun 16 14:56:46.468562 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 86/182] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:46 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:47.234204 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a102b938-489b-4912-bec4-ae1c5fac522d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:47.234800 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a102b938-489b-4912-bec4-ae1c5fac522d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:47.240722 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a102b938-489b-4912-bec4-ae1c5fac522d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:47.241165 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a102b938-489b-4912-bec4-ae1c5fac522d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:47.241913 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a102b938-489b-4912-bec4-ae1c5fac522d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:47.242337 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a102b938-489b-4912-bec4-ae1c5fac522d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:47.382722 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a102b938-489b-4912-bec4-ae1c5fac522d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:47.390141 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a102b938-489b-4912-bec4-ae1c5fac522d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.159750 Jun 16 14:56:47.390701 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 97/183] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:47 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:47.488856 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-98dac269-ac65-4295-b213-32f55adc3c29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:47.490313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-98dac269-ac65-4295-b213-32f55adc3c29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:47.508268 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-98dac269-ac65-4295-b213-32f55adc3c29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:47.508797 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-98dac269-ac65-4295-b213-32f55adc3c29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:47.509739 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-98dac269-ac65-4295-b213-32f55adc3c29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:47.510203 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-98dac269-ac65-4295-b213-32f55adc3c29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:47.693097 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-98dac269-ac65-4295-b213-32f55adc3c29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:47.701585 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-98dac269-ac65-4295-b213-32f55adc3c29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:47.703092 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-98dac269-ac65-4295-b213-32f55adc3c29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:47.704840 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-98dac269-ac65-4295-b213-32f55adc3c29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1407 microversion: 2.20 time: 0.221681 Jun 16 14:56:47.705412 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 87/184] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:47 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:48.409301 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1574ac40-5556-4973-946c-4264488a456b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:48.410939 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-1574ac40-5556-4973-946c-4264488a456b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:48.430556 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1574ac40-5556-4973-946c-4264488a456b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:48.431517 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1574ac40-5556-4973-946c-4264488a456b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:48.432342 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1574ac40-5556-4973-946c-4264488a456b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:48.433655 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1574ac40-5556-4973-946c-4264488a456b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:48.602255 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1574ac40-5556-4973-946c-4264488a456b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:48.609906 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1574ac40-5556-4973-946c-4264488a456b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.206433 Jun 16 14:56:48.612282 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 98/185] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:48 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:48.702680 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6018bc0a-2709-4bba-acec-a5a2282e9ac7 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75b682e5-87cd-4d83-ab73-40436c9e07d2"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:56:48.705599 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6018bc0a-2709-4bba-acec-a5a2282e9ac7 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:48.715033 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6018bc0a-2709-4bba-acec-a5a2282e9ac7 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:48.715908 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6018bc0a-2709-4bba-acec-a5a2282e9ac7 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:48.717156 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6018bc0a-2709-4bba-acec-a5a2282e9ac7 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:48.720228 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6018bc0a-2709-4bba-acec-a5a2282e9ac7 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:48.722912 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a93797da-ffaf-4967-a0df-603f0c0c27a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:48.723722 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a93797da-ffaf-4967-a0df-603f0c0c27a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:48.731870 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a93797da-ffaf-4967-a0df-603f0c0c27a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:48.732834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a93797da-ffaf-4967-a0df-603f0c0c27a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:48.734491 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a93797da-ffaf-4967-a0df-603f0c0c27a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:48.735085 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a93797da-ffaf-4967-a0df-603f0c0c27a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:49.112498 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a93797da-ffaf-4967-a0df-603f0c0c27a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:49.123166 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a93797da-ffaf-4967-a0df-603f0c0c27a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:49.124932 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a93797da-ffaf-4967-a0df-603f0c0c27a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:49.126447 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a93797da-ffaf-4967-a0df-603f0c0c27a8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1599 microversion: 2.20 time: 0.407551 Jun 16 14:56:49.127038 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 99/186] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:56:48 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1599 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:49.145792 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8a5c1e6d-75c7-49dd-8bd1-2d04c2697733 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:49.147890 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-8a5c1e6d-75c7-49dd-8bd1-2d04c2697733 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:49.154409 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8a5c1e6d-75c7-49dd-8bd1-2d04c2697733 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:49.154862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8a5c1e6d-75c7-49dd-8bd1-2d04c2697733 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:49.155925 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8a5c1e6d-75c7-49dd-8bd1-2d04c2697733 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:49.156360 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8a5c1e6d-75c7-49dd-8bd1-2d04c2697733 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:49.189449 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:49.227300 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6018bc0a-2709-4bba-acec-a5a2282e9ac7 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "POST /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.529079 Jun 16 14:56:49.228530 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 88/187] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Jun 16 14:56:48 2022] POST /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f/os-volume_attachments => generated 194 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:56:49.257170 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8a5c1e6d-75c7-49dd-8bd1-2d04c2697733 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.115657 Jun 16 14:56:49.258440 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 100/188] 10.222.0.76 () {60 vars in 1315 bytes} [Thu Jun 16 14:56:49 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 14:56:49.630450 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1f25cbb1-0f86-4338-ac8f-36c4c23d02bd tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:49.634206 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1f25cbb1-0f86-4338-ac8f-36c4c23d02bd tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:49.641621 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1f25cbb1-0f86-4338-ac8f-36c4c23d02bd tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:49.643091 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1f25cbb1-0f86-4338-ac8f-36c4c23d02bd tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:49.644009 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1f25cbb1-0f86-4338-ac8f-36c4c23d02bd tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:49.644456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1f25cbb1-0f86-4338-ac8f-36c4c23d02bd tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:49.919578 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1f25cbb1-0f86-4338-ac8f-36c4c23d02bd tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:49.934850 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1f25cbb1-0f86-4338-ac8f-36c4c23d02bd tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.309460 Jun 16 14:56:49.936735 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 89/189] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:49 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:56:50.677497 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-8e715217-68b5-4dea-95ee-68b02bd33059 req-b3dcab93-5be6-4052-8937-7d727b722741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "663488be-459f-4a58-aa1c-82be04813a2f", "tag": "5508bdf2-993b-44f0-8926-4159b1e31b1d"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:56:50.692498 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-8e715217-68b5-4dea-95ee-68b02bd33059 req-b3dcab93-5be6-4052-8937-7d727b722741 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:50.693186 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-8e715217-68b5-4dea-95ee-68b02bd33059 req-b3dcab93-5be6-4052-8937-7d727b722741 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:50.706263 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-8e715217-68b5-4dea-95ee-68b02bd33059 req-b3dcab93-5be6-4052-8937-7d727b722741 service nova] Creating event network-changed:5508bdf2-993b-44f0-8926-4159b1e31b1d for instance 663488be-459f-4a58-aa1c-82be04813a2f on hv-cinder-83716 Jun 16 14:56:50.712113 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-8e715217-68b5-4dea-95ee-68b02bd33059 req-b3dcab93-5be6-4052-8937-7d727b722741 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038399 Jun 16 14:56:50.712711 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 101/190] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:56:50.953615 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-25bf71e0-f695-446b-81ac-cb7fcc36d71a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:50.954810 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-25bf71e0-f695-446b-81ac-cb7fcc36d71a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:50.963433 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-25bf71e0-f695-446b-81ac-cb7fcc36d71a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:50.964215 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-25bf71e0-f695-446b-81ac-cb7fcc36d71a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:50.965035 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-25bf71e0-f695-446b-81ac-cb7fcc36d71a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:50.969752 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-25bf71e0-f695-446b-81ac-cb7fcc36d71a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:51.195837 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-25bf71e0-f695-446b-81ac-cb7fcc36d71a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:51.208092 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-25bf71e0-f695-446b-81ac-cb7fcc36d71a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1321 microversion: 2.1 time: 0.255692 Jun 16 14:56:51.208780 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 90/191] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:50 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:52.228969 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-fda151bd-9d02-4012-af88-726bef597055 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:52.230497 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-fda151bd-9d02-4012-af88-726bef597055 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:52.237947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fda151bd-9d02-4012-af88-726bef597055 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:52.238743 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fda151bd-9d02-4012-af88-726bef597055 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:52.239964 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fda151bd-9d02-4012-af88-726bef597055 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:52.240591 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fda151bd-9d02-4012-af88-726bef597055 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:52.509678 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fda151bd-9d02-4012-af88-726bef597055 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:52.518753 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-fda151bd-9d02-4012-af88-726bef597055 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1515 microversion: 2.1 time: 0.295144 Jun 16 14:56:52.519321 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 102/192] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:52 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1515 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:52.537624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a8c06b7c-b589-474e-9978-a2c85a23ecfe tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:56:52.539016 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a8c06b7c-b589-474e-9978-a2c85a23ecfe tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:52.547199 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a8c06b7c-b589-474e-9978-a2c85a23ecfe tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:52.547892 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a8c06b7c-b589-474e-9978-a2c85a23ecfe tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:52.548891 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a8c06b7c-b589-474e-9978-a2c85a23ecfe tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:52.549391 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a8c06b7c-b589-474e-9978-a2c85a23ecfe tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:52.580067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-a8c06b7c-b589-474e-9978-a2c85a23ecfe tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lazy-loading 'flavor' on Instance uuid e786be21-8e43-4fdb-9790-7aabbad8a47c {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:56:52.734451 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a8c06b7c-b589-474e-9978-a2c85a23ecfe tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "POST /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c/action" status: 200 len: 32 microversion: 2.1 time: 0.201665 Jun 16 14:56:52.740894 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 91/193] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Jun 16 14:56:52 2022] POST /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c/action => generated 32 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:56:52.746294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-64752c21-4ff4-4645-aeb8-93dd70826f94 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:52.747571 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-64752c21-4ff4-4645-aeb8-93dd70826f94 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:52.758488 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-64752c21-4ff4-4645-aeb8-93dd70826f94 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:52.759295 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-64752c21-4ff4-4645-aeb8-93dd70826f94 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:52.762295 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-64752c21-4ff4-4645-aeb8-93dd70826f94 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:52.762732 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-64752c21-4ff4-4645-aeb8-93dd70826f94 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:53.174993 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-64752c21-4ff4-4645-aeb8-93dd70826f94 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:53.184242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-64752c21-4ff4-4645-aeb8-93dd70826f94 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.441399 Jun 16 14:56:53.185355 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 103/194] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:52 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:54.202663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-db1e7b0a-ce43-4b13-a663-cbd0c110d3d6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:54.204659 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-db1e7b0a-ce43-4b13-a663-cbd0c110d3d6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:54.211854 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-db1e7b0a-ce43-4b13-a663-cbd0c110d3d6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:54.212495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-db1e7b0a-ce43-4b13-a663-cbd0c110d3d6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:54.213259 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-db1e7b0a-ce43-4b13-a663-cbd0c110d3d6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:54.214036 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-db1e7b0a-ce43-4b13-a663-cbd0c110d3d6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:54.615149 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-db1e7b0a-ce43-4b13-a663-cbd0c110d3d6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:54.629145 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-db1e7b0a-ce43-4b13-a663-cbd0c110d3d6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.431058 Jun 16 14:56:54.641544 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 92/195] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:54 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:55.646737 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4f312bfe-a0a1-42eb-93c1-8228848cff2e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:55.648379 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4f312bfe-a0a1-42eb-93c1-8228848cff2e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:55.656227 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4f312bfe-a0a1-42eb-93c1-8228848cff2e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:55.656855 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4f312bfe-a0a1-42eb-93c1-8228848cff2e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:55.658224 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4f312bfe-a0a1-42eb-93c1-8228848cff2e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:55.658820 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4f312bfe-a0a1-42eb-93c1-8228848cff2e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:55.691085 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=100 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:55.881322 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4f312bfe-a0a1-42eb-93c1-8228848cff2e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:55.892208 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4f312bfe-a0a1-42eb-93c1-8228848cff2e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.249156 Jun 16 14:56:55.892823 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 104/196] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:55 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:56.911737 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-fc8d3af0-906f-4f0d-bda3-95efe131e52f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:56.912851 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-fc8d3af0-906f-4f0d-bda3-95efe131e52f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:56.926720 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fc8d3af0-906f-4f0d-bda3-95efe131e52f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:56.930570 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fc8d3af0-906f-4f0d-bda3-95efe131e52f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:56.931747 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fc8d3af0-906f-4f0d-bda3-95efe131e52f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:56.933184 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fc8d3af0-906f-4f0d-bda3-95efe131e52f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:57.138801 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fc8d3af0-906f-4f0d-bda3-95efe131e52f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:57.149063 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-fc8d3af0-906f-4f0d-bda3-95efe131e52f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.243152 Jun 16 14:56:57.162279 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 93/197] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:56 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:58.166705 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-06895fa5-19c8-4cc6-8499-1b7131bad17e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:58.168691 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-06895fa5-19c8-4cc6-8499-1b7131bad17e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:58.177258 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-06895fa5-19c8-4cc6-8499-1b7131bad17e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:58.177871 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-06895fa5-19c8-4cc6-8499-1b7131bad17e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:58.178653 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-06895fa5-19c8-4cc6-8499-1b7131bad17e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:58.179158 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-06895fa5-19c8-4cc6-8499-1b7131bad17e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:58.358313 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-06895fa5-19c8-4cc6-8499-1b7131bad17e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:58.368256 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-06895fa5-19c8-4cc6-8499-1b7131bad17e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.205629 Jun 16 14:56:58.378768 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 105/198] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:58 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:56:59.386510 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-68d0d441-486c-4eb6-917d-566dc45dab0e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:56:59.387208 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-68d0d441-486c-4eb6-917d-566dc45dab0e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:56:59.393841 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-68d0d441-486c-4eb6-917d-566dc45dab0e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:59.394362 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-68d0d441-486c-4eb6-917d-566dc45dab0e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:59.395212 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-68d0d441-486c-4eb6-917d-566dc45dab0e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:59.395739 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-68d0d441-486c-4eb6-917d-566dc45dab0e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:59.559921 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-68d0d441-486c-4eb6-917d-566dc45dab0e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:56:59.567911 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-68d0d441-486c-4eb6-917d-566dc45dab0e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.185800 Jun 16 14:56:59.568481 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 94/199] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:56:59 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:00.589329 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-199a08e1-8ae3-4ff0-a54a-c9a9dd76fb68 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:00.589943 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-199a08e1-8ae3-4ff0-a54a-c9a9dd76fb68 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:00.596456 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-199a08e1-8ae3-4ff0-a54a-c9a9dd76fb68 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:00.596903 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-199a08e1-8ae3-4ff0-a54a-c9a9dd76fb68 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:00.597848 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-199a08e1-8ae3-4ff0-a54a-c9a9dd76fb68 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:00.598270 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-199a08e1-8ae3-4ff0-a54a-c9a9dd76fb68 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:00.739441 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-199a08e1-8ae3-4ff0-a54a-c9a9dd76fb68 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:00.751277 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-199a08e1-8ae3-4ff0-a54a-c9a9dd76fb68 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.166072 Jun 16 14:57:00.752164 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 106/200] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:00 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:01.769451 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3e675918-4100-4a4a-b1e9-b2d530dd49d8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:01.770051 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3e675918-4100-4a4a-b1e9-b2d530dd49d8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:01.776582 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e675918-4100-4a4a-b1e9-b2d530dd49d8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:01.777024 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e675918-4100-4a4a-b1e9-b2d530dd49d8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:01.777769 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e675918-4100-4a4a-b1e9-b2d530dd49d8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:01.778197 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e675918-4100-4a4a-b1e9-b2d530dd49d8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:01.908803 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3e675918-4100-4a4a-b1e9-b2d530dd49d8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:01.916376 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3e675918-4100-4a4a-b1e9-b2d530dd49d8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.151273 Jun 16 14:57:01.916940 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 95/201] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:01 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:02.540350 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b4330802-5354-468b-ae90-0ad4c27ad541 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:02.540873 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b4330802-5354-468b-ae90-0ad4c27ad541 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:02.546947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b4330802-5354-468b-ae90-0ad4c27ad541 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:02.547424 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b4330802-5354-468b-ae90-0ad4c27ad541 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:02.548227 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b4330802-5354-468b-ae90-0ad4c27ad541 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:02.548661 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b4330802-5354-468b-ae90-0ad4c27ad541 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:02.574608 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b4330802-5354-468b-ae90-0ad4c27ad541 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Going to try to terminate instance {{(pid=117443) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:57:02.668392 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b4330802-5354-468b-ae90-0ad4c27ad541 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "DELETE /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 204 len: 0 microversion: 2.1 time: 0.131466 Jun 16 14:57:02.674387 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 107/202] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 14:57:02 2022] DELETE /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:57:02.677077 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-72eff86a-0352-4186-ac6f-4b8304bc8e61 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:02.677679 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-72eff86a-0352-4186-ac6f-4b8304bc8e61 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:02.683982 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-72eff86a-0352-4186-ac6f-4b8304bc8e61 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:02.684420 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-72eff86a-0352-4186-ac6f-4b8304bc8e61 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:02.685171 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-72eff86a-0352-4186-ac6f-4b8304bc8e61 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:02.685597 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-72eff86a-0352-4186-ac6f-4b8304bc8e61 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:02.813182 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-72eff86a-0352-4186-ac6f-4b8304bc8e61 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:02.821270 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-72eff86a-0352-4186-ac6f-4b8304bc8e61 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1553 microversion: 2.1 time: 0.148047 Jun 16 14:57:02.821826 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 96/203] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:02 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:02.934250 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6e23dc83-79bd-442b-889a-ce5211163135 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:02.934970 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6e23dc83-79bd-442b-889a-ce5211163135 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:02.941587 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6e23dc83-79bd-442b-889a-ce5211163135 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:02.942030 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6e23dc83-79bd-442b-889a-ce5211163135 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:02.942789 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6e23dc83-79bd-442b-889a-ce5211163135 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:02.943218 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6e23dc83-79bd-442b-889a-ce5211163135 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:03.078441 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6e23dc83-79bd-442b-889a-ce5211163135 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:03.086549 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6e23dc83-79bd-442b-889a-ce5211163135 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.156518 Jun 16 14:57:03.087105 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 108/204] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:02 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:03.838775 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-99374931-dfaa-44d5-b001-4e6b9df9f6c5 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:03.839400 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-99374931-dfaa-44d5-b001-4e6b9df9f6c5 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:03.846272 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-99374931-dfaa-44d5-b001-4e6b9df9f6c5 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:03.846712 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-99374931-dfaa-44d5-b001-4e6b9df9f6c5 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:03.847453 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-99374931-dfaa-44d5-b001-4e6b9df9f6c5 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:03.847917 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-99374931-dfaa-44d5-b001-4e6b9df9f6c5 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:03.976989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-99374931-dfaa-44d5-b001-4e6b9df9f6c5 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:03.986093 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-99374931-dfaa-44d5-b001-4e6b9df9f6c5 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1553 microversion: 2.1 time: 0.151078 Jun 16 14:57:03.986665 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 97/205] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:03 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:04.102400 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-5d35d669-249e-4652-ae7f-36310955991d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:04.103108 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-5d35d669-249e-4652-ae7f-36310955991d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:04.109132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5d35d669-249e-4652-ae7f-36310955991d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:04.109625 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5d35d669-249e-4652-ae7f-36310955991d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:04.110385 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5d35d669-249e-4652-ae7f-36310955991d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:04.110810 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5d35d669-249e-4652-ae7f-36310955991d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:04.247884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-5d35d669-249e-4652-ae7f-36310955991d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:04.256133 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-5d35d669-249e-4652-ae7f-36310955991d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.157446 Jun 16 14:57:04.256878 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 109/206] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:04 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:05.002784 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-91eb9cee-f97b-4e87-bcb6-a18ce417557e tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:05.003426 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-91eb9cee-f97b-4e87-bcb6-a18ce417557e tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:05.005895 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=56 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:05.011070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-91eb9cee-f97b-4e87-bcb6-a18ce417557e tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:05.011511 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-91eb9cee-f97b-4e87-bcb6-a18ce417557e tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:05.012289 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-91eb9cee-f97b-4e87-bcb6-a18ce417557e tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:05.012720 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-91eb9cee-f97b-4e87-bcb6-a18ce417557e tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:05.145368 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-91eb9cee-f97b-4e87-bcb6-a18ce417557e tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:05.153567 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-91eb9cee-f97b-4e87-bcb6-a18ce417557e tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1553 microversion: 2.1 time: 0.155118 Jun 16 14:57:05.154126 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 98/207] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:04 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:05.273721 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d1f2234d-3ee0-418f-b5de-e1af7d93eb0a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:05.274277 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d1f2234d-3ee0-418f-b5de-e1af7d93eb0a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:05.280351 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d1f2234d-3ee0-418f-b5de-e1af7d93eb0a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:05.281067 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d1f2234d-3ee0-418f-b5de-e1af7d93eb0a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:05.282387 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d1f2234d-3ee0-418f-b5de-e1af7d93eb0a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:05.282779 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d1f2234d-3ee0-418f-b5de-e1af7d93eb0a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:05.432006 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d1f2234d-3ee0-418f-b5de-e1af7d93eb0a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:05.440845 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d1f2234d-3ee0-418f-b5de-e1af7d93eb0a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.171165 Jun 16 14:57:05.441628 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 110/208] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:05 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:06.172790 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f7ccba53-f81c-45fe-9420-9c08102b3959 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:06.173511 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f7ccba53-f81c-45fe-9420-9c08102b3959 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:06.182048 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f7ccba53-f81c-45fe-9420-9c08102b3959 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:06.182694 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f7ccba53-f81c-45fe-9420-9c08102b3959 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:06.183829 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f7ccba53-f81c-45fe-9420-9c08102b3959 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:06.184405 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f7ccba53-f81c-45fe-9420-9c08102b3959 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:06.396954 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f7ccba53-f81c-45fe-9420-9c08102b3959 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:06.410699 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f7ccba53-f81c-45fe-9420-9c08102b3959 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1553 microversion: 2.1 time: 0.242898 Jun 16 14:57:06.421941 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 99/209] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:06 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1553 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:06.458417 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-82b88143-cdbe-4a7a-acbd-25d78bf796db tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:06.459386 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-82b88143-cdbe-4a7a-acbd-25d78bf796db tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:06.466091 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-82b88143-cdbe-4a7a-acbd-25d78bf796db tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:06.467414 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-82b88143-cdbe-4a7a-acbd-25d78bf796db tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:06.468581 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-82b88143-cdbe-4a7a-acbd-25d78bf796db tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:06.469432 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-82b88143-cdbe-4a7a-acbd-25d78bf796db tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:06.760557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-82b88143-cdbe-4a7a-acbd-25d78bf796db tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:06.770173 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-82b88143-cdbe-4a7a-acbd-25d78bf796db tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.315479 Jun 16 14:57:06.770752 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 111/210] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:06 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:07.372187 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-0dc6224c-4fd8-4cc3-9acd-f854103f0771 req-2f1ff7a1-fefe-42f6-8d62-411d73ce1794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940ece90-bd85-4bf1-9343-5e81198c0e5f", "name": "network-vif-deleted", "tag": "d6a6ee13-981d-4dc8-b333-8781a722b480"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:07.386021 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-0dc6224c-4fd8-4cc3-9acd-f854103f0771 req-2f1ff7a1-fefe-42f6-8d62-411d73ce1794 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:07.386434 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-0dc6224c-4fd8-4cc3-9acd-f854103f0771 req-2f1ff7a1-fefe-42f6-8d62-411d73ce1794 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:07.403047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-0dc6224c-4fd8-4cc3-9acd-f854103f0771 req-2f1ff7a1-fefe-42f6-8d62-411d73ce1794 service nova] Creating event network-vif-deleted:d6a6ee13-981d-4dc8-b333-8781a722b480 for instance 940ece90-bd85-4bf1-9343-5e81198c0e5f on hv-cinder-83716 Jun 16 14:57:07.409672 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-0dc6224c-4fd8-4cc3-9acd-f854103f0771 req-2f1ff7a1-fefe-42f6-8d62-411d73ce1794 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043015 Jun 16 14:57:07.410256 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 100/211] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:07.430891 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-42bf5d62-3371-4d64-afd6-4e4f7e5ebf04 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:07.432169 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-42bf5d62-3371-4d64-afd6-4e4f7e5ebf04 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:07.440344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-42bf5d62-3371-4d64-afd6-4e4f7e5ebf04 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:07.441686 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-42bf5d62-3371-4d64-afd6-4e4f7e5ebf04 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:07.443159 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-42bf5d62-3371-4d64-afd6-4e4f7e5ebf04 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:07.444578 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-42bf5d62-3371-4d64-afd6-4e4f7e5ebf04 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:07.526584 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-42bf5d62-3371-4d64-afd6-4e4f7e5ebf04 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4eda7cae22441e9a56f1c463a5688b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a56373cfeb74f1f9adec2d33c9d5b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:07.534753 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-42bf5d62-3371-4d64-afd6-4e4f7e5ebf04 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 200 len: 1345 microversion: 2.1 time: 0.109390 Jun 16 14:57:07.535318 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 112/212] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:07 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 1345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:07.788580 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0f971995-97b1-4e67-87a9-e4dd8866952f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:07.789350 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0f971995-97b1-4e67-87a9-e4dd8866952f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:07.795818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0f971995-97b1-4e67-87a9-e4dd8866952f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:07.796666 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0f971995-97b1-4e67-87a9-e4dd8866952f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:07.797700 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0f971995-97b1-4e67-87a9-e4dd8866952f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:07.812850 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0f971995-97b1-4e67-87a9-e4dd8866952f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:08.053927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0f971995-97b1-4e67-87a9-e4dd8866952f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:08.061499 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0f971995-97b1-4e67-87a9-e4dd8866952f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.277121 Jun 16 14:57:08.062376 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 101/213] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:07 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:08.553052 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-59efc9aa-9654-4d78-affc-a6477e1151ad tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:08.553733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-59efc9aa-9654-4d78-affc-a6477e1151ad tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:08.560771 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-59efc9aa-9654-4d78-affc-a6477e1151ad tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:08.561027 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-59efc9aa-9654-4d78-affc-a6477e1151ad tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:08.562306 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-59efc9aa-9654-4d78-affc-a6477e1151ad tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:08.562756 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-59efc9aa-9654-4d78-affc-a6477e1151ad tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:08.588005 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-59efc9aa-9654-4d78-affc-a6477e1151ad tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] HTTP exception thrown: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-59efc9aa-9654-4d78-affc-a6477e1151ad tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Request method failure captured: Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f HTTP/1.1 Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0R1g_jeFh69wAKDHrnwFVkegJVupzWjmt9z2qQWKqDPH2KBXNPlJWphIMSmZsnwMVkWu2wKLUQeYF2lkU1-fdbxdhZ-A6kkQQaWBbLyryUmDrg-oLv_L7R3_-IixYsmc71_sKjqHdvdjFvWkWNTUeZGs3DO5g6w_fpa1Z2wH_ZmVjs Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 8a56373cfeb74f1f9adec2d33c9d5b7f Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-DeleteServersTestJSON-870771930 Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 14:57:08.606423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 14:57:08.607733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8a56373cfeb74f1f9adec2d33c9d5b7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8a56373cfeb74f1f9adec2d33c9d5b7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8a56373cfeb74f1f9adec2d33c9d5b7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8a56373cfeb74f1f9adec2d33c9d5b7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:57:08.607733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-DeleteServersTestJSON-870771930 Jun 16 14:57:08.607733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 8a56373cfeb74f1f9adec2d33c9d5b7f Jun 16 14:57:08.607733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-DeleteServersTestJSON-870771930 Jun 16 14:57:08.607733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-DeleteServersTestJSON-870771930-project Jun 16 14:57:08.607733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 14:57:08.607733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 14:57:08.607733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: a4eda7cae22441e9a56f1c463a5688b7 Jun 16 14:57:08.607733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-DeleteServersTestJSON-870771930-project Jun 16 14:57:08.607733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 14:57:08.607733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:08.607733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': '940ece90-bd85-4bf1-9343-5e81198c0e5f'} Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:57:08.608580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:57:08.609915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:57:08.609915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:57:08.609915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:57:08.609915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:57:08.609915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:57:08.609915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:57:08.609915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:57:08.609915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:08.609915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.609915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:08.609915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.609915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:08.609915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:08.609915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:08.609915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:57:08.609915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:57:08.609915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:08.609915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.610889 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-59efc9aa-9654-4d78-affc-a6477e1151ad tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Returning 404 to user: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:57:08.610889 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-59efc9aa-9654-4d78-affc-a6477e1151ad tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 404 len: 111 microversion: 2.1 time: 0.061058 Jun 16 14:57:08.612031 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 113/214] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:08 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:57:08.733107 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-85b9ccdd-36cb-43b8-b0fd-2177198aa566 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:08.734046 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-85b9ccdd-36cb-43b8-b0fd-2177198aa566 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:08.740917 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-85b9ccdd-36cb-43b8-b0fd-2177198aa566 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:08.741351 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-85b9ccdd-36cb-43b8-b0fd-2177198aa566 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:08.742277 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-85b9ccdd-36cb-43b8-b0fd-2177198aa566 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:08.742705 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-85b9ccdd-36cb-43b8-b0fd-2177198aa566 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:08.757340 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-85b9ccdd-36cb-43b8-b0fd-2177198aa566 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] HTTP exception thrown: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-85b9ccdd-36cb-43b8-b0fd-2177198aa566 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Request method failure captured: Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f/os-volume_attachments HTTP/1.1 Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0R1g_jeFh69wAKDHrnwFVkegJVupzWjmt9z2qQWKqDPH2KBXNPlJWphIMSmZsnwMVkWu2wKLUQeYF2lkU1-fdbxdhZ-A6kkQQaWBbLyryUmDrg-oLv_L7R3_-IixYsmc71_sKjqHdvdjFvWkWNTUeZGs3DO5g6w_fpa1Z2wH_ZmVjs Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 8a56373cfeb74f1f9adec2d33c9d5b7f Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-DeleteServersTestJSON-870771930 Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 14:57:08.761965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 14:57:08.763330 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8a56373cfeb74f1f9adec2d33c9d5b7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8a56373cfeb74f1f9adec2d33c9d5b7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8a56373cfeb74f1f9adec2d33c9d5b7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8a56373cfeb74f1f9adec2d33c9d5b7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:57:08.763330 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-DeleteServersTestJSON-870771930 Jun 16 14:57:08.763330 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 8a56373cfeb74f1f9adec2d33c9d5b7f Jun 16 14:57:08.763330 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-DeleteServersTestJSON-870771930 Jun 16 14:57:08.763330 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-DeleteServersTestJSON-870771930-project Jun 16 14:57:08.763330 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 14:57:08.763330 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 14:57:08.763330 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: a4eda7cae22441e9a56f1c463a5688b7 Jun 16 14:57:08.763330 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-DeleteServersTestJSON-870771930-project Jun 16 14:57:08.763330 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 14:57:08.763330 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:08.763330 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'server_id': '940ece90-bd85-4bf1-9343-5e81198c0e5f'} Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:57:08.764012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:08.765037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.767164 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-85b9ccdd-36cb-43b8-b0fd-2177198aa566 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Returning 404 to user: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:57:08.767164 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-85b9ccdd-36cb-43b8-b0fd-2177198aa566 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034412 Jun 16 14:57:08.767164 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 102/215] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 14:57:08 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:57:09.079160 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-9d34b603-48e2-436c-85ed-1caf6dfd6bda tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:09.080518 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-9d34b603-48e2-436c-85ed-1caf6dfd6bda tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:09.086765 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9d34b603-48e2-436c-85ed-1caf6dfd6bda tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:09.087460 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9d34b603-48e2-436c-85ed-1caf6dfd6bda tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:09.088539 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9d34b603-48e2-436c-85ed-1caf6dfd6bda tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:09.089155 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9d34b603-48e2-436c-85ed-1caf6dfd6bda tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:09.381525 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-9d34b603-48e2-436c-85ed-1caf6dfd6bda tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:09.393620 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-9d34b603-48e2-436c-85ed-1caf6dfd6bda tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.318580 Jun 16 14:57:09.394573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 114/216] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:09 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:10.102947 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ff624248-e6c9-4feb-acfa-d07ece7eb974 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:10.103435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ff624248-e6c9-4feb-acfa-d07ece7eb974 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:10.112030 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ff624248-e6c9-4feb-acfa-d07ece7eb974 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:10.112496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ff624248-e6c9-4feb-acfa-d07ece7eb974 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:10.113538 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ff624248-e6c9-4feb-acfa-d07ece7eb974 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:10.114018 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ff624248-e6c9-4feb-acfa-d07ece7eb974 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:10.134382 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-ff624248-e6c9-4feb-acfa-d07ece7eb974 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] HTTP exception thrown: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ff624248-e6c9-4feb-acfa-d07ece7eb974 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Request method failure captured: Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: DELETE /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f HTTP/1.1 Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0R1g_jeFh69wAKDHrnwFVkegJVupzWjmt9z2qQWKqDPH2KBXNPlJWphIMSmZsnwMVkWu2wKLUQeYF2lkU1-fdbxdhZ-A6kkQQaWBbLyryUmDrg-oLv_L7R3_-IixYsmc71_sKjqHdvdjFvWkWNTUeZGs3DO5g6w_fpa1Z2wH_ZmVjs Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 8a56373cfeb74f1f9adec2d33c9d5b7f Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-DeleteServersTestJSON-870771930 Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 14:57:10.136628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 14:57:10.138120 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8a56373cfeb74f1f9adec2d33c9d5b7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8a56373cfeb74f1f9adec2d33c9d5b7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8a56373cfeb74f1f9adec2d33c9d5b7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8a56373cfeb74f1f9adec2d33c9d5b7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:57:10.138120 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-DeleteServersTestJSON-870771930 Jun 16 14:57:10.138120 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 8a56373cfeb74f1f9adec2d33c9d5b7f Jun 16 14:57:10.138120 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-DeleteServersTestJSON-870771930 Jun 16 14:57:10.138120 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-DeleteServersTestJSON-870771930-project Jun 16 14:57:10.138120 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 14:57:10.138120 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 14:57:10.138120 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: a4eda7cae22441e9a56f1c463a5688b7 Jun 16 14:57:10.138120 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-DeleteServersTestJSON-870771930-project Jun 16 14:57:10.138120 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 14:57:10.138120 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:10.138120 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': '940ece90-bd85-4bf1-9343-5e81198c0e5f'} Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:57:10.143180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:10.144818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:57:10.146510 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ff624248-e6c9-4feb-acfa-d07ece7eb974 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Returning 404 to user: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:57:10.146510 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ff624248-e6c9-4feb-acfa-d07ece7eb974 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "DELETE /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 404 len: 111 microversion: 2.1 time: 0.041113 Jun 16 14:57:10.146510 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 103/217] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 14:57:10 2022] DELETE /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 14:57:10.149884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f2e2c4fe-6934-48c2-a1a7-fbca31522ef0 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:10.150498 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f2e2c4fe-6934-48c2-a1a7-fbca31522ef0 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] [instance: 940ece90-bd85-4bf1-9343-5e81198c0e5f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:10.158232 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f2e2c4fe-6934-48c2-a1a7-fbca31522ef0 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:10.158677 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f2e2c4fe-6934-48c2-a1a7-fbca31522ef0 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:10.159443 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f2e2c4fe-6934-48c2-a1a7-fbca31522ef0 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:10.159919 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f2e2c4fe-6934-48c2-a1a7-fbca31522ef0 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:10.174493 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-f2e2c4fe-6934-48c2-a1a7-fbca31522ef0 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] HTTP exception thrown: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f2e2c4fe-6934-48c2-a1a7-fbca31522ef0 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Request method failure captured: Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f HTTP/1.1 Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0R1g_jeFh69wAKDHrnwFVkegJVupzWjmt9z2qQWKqDPH2KBXNPlJWphIMSmZsnwMVkWu2wKLUQeYF2lkU1-fdbxdhZ-A6kkQQaWBbLyryUmDrg-oLv_L7R3_-IixYsmc71_sKjqHdvdjFvWkWNTUeZGs3DO5g6w_fpa1Z2wH_ZmVjs Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 8a56373cfeb74f1f9adec2d33c9d5b7f Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-DeleteServersTestJSON-870771930 Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 14:57:10.176181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 14:57:10.177586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8a56373cfeb74f1f9adec2d33c9d5b7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8a56373cfeb74f1f9adec2d33c9d5b7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8a56373cfeb74f1f9adec2d33c9d5b7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8a56373cfeb74f1f9adec2d33c9d5b7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:57:10.177586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-DeleteServersTestJSON-870771930 Jun 16 14:57:10.177586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 8a56373cfeb74f1f9adec2d33c9d5b7f Jun 16 14:57:10.177586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-DeleteServersTestJSON-870771930 Jun 16 14:57:10.177586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-DeleteServersTestJSON-870771930-project Jun 16 14:57:10.177586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 14:57:10.177586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 14:57:10.177586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: a4eda7cae22441e9a56f1c463a5688b7 Jun 16 14:57:10.177586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-DeleteServersTestJSON-870771930-project Jun 16 14:57:10.177586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 14:57:10.177586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:10.177586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': '940ece90-bd85-4bf1-9343-5e81198c0e5f'} Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:57:10.178455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:57:10.180016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:57:10.180016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:57:10.180016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:57:10.180016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:57:10.180016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:57:10.180016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:57:10.180016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:57:10.180016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:10.180016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:57:10.180016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:10.180016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:57:10.180016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:10.180016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:10.180016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:10.180016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:57:10.180016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:57:10.180016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. Jun 16 14:57:10.180016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:57:10.181166 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f2e2c4fe-6934-48c2-a1a7-fbca31522ef0 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] Returning 404 to user: Instance 940ece90-bd85-4bf1-9343-5e81198c0e5f could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:57:10.181166 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f2e2c4fe-6934-48c2-a1a7-fbca31522ef0 tempest-DeleteServersTestJSON-870771930 tempest-DeleteServersTestJSON-870771930-project] 10.222.0.76 "GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f" status: 404 len: 111 microversion: 2.1 time: 0.033375 Jun 16 14:57:10.181953 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 115/218] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:10 2022] GET /compute/v2.1/servers/940ece90-bd85-4bf1-9343-5e81198c0e5f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:57:10.411972 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7004c667-4192-4c60-9f68-cdad600354c5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:10.412686 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7004c667-4192-4c60-9f68-cdad600354c5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:10.425406 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7004c667-4192-4c60-9f68-cdad600354c5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:10.425933 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7004c667-4192-4c60-9f68-cdad600354c5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:10.428671 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7004c667-4192-4c60-9f68-cdad600354c5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:10.429301 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7004c667-4192-4c60-9f68-cdad600354c5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:11.095733 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7004c667-4192-4c60-9f68-cdad600354c5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:11.105747 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7004c667-4192-4c60-9f68-cdad600354c5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.698699 Jun 16 14:57:11.107020 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 104/219] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:10 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:11.718497 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e7526430-b705-49ba-98b2-d94b27ad90b7 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-616275034", "imageRef": "f2f37ffa-db20-478d-84c0-b429a987933c", "flavorRef": "452", "networks": [{"uuid": "5b7fed89-cfd8-4506-aae7-73bc629e09da"}]}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:11.788938 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.network.neutron [None req-e7526430-b705-49ba-98b2-d94b27ad90b7 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] validate_networks() for [('5b7fed89-cfd8-4506-aae7-73bc629e09da', None, None, None, None, None)] {{(pid=117443) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:57:12.131424 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b59643e4-1039-44c4-86c3-03cc02200f8b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:12.132709 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b59643e4-1039-44c4-86c3-03cc02200f8b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:12.147492 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b59643e4-1039-44c4-86c3-03cc02200f8b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:12.148514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b59643e4-1039-44c4-86c3-03cc02200f8b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:12.150409 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b59643e4-1039-44c4-86c3-03cc02200f8b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:12.151641 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b59643e4-1039-44c4-86c3-03cc02200f8b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:12.158737 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:12.498970 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b59643e4-1039-44c4-86c3-03cc02200f8b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:12.508514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b59643e4-1039-44c4-86c3-03cc02200f8b tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.386536 Jun 16 14:57:12.509290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 105/220] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:12 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:12.633521 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-e7526430-b705-49ba-98b2-d94b27ad90b7 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Flavor limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:57:12.634126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-e7526430-b705-49ba-98b2-d94b27ad90b7 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Image limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:57:12.634785 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-e7526430-b705-49ba-98b2-d94b27ad90b7 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Flavor pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:57:12.636007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-e7526430-b705-49ba-98b2-d94b27ad90b7 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Image pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:57:12.636418 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-e7526430-b705-49ba-98b2-d94b27ad90b7 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:57:12.648139 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e7526430-b705-49ba-98b2-d94b27ad90b7 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:12.648587 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e7526430-b705-49ba-98b2-d94b27ad90b7 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:12.649408 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e7526430-b705-49ba-98b2-d94b27ad90b7 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:12.649841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e7526430-b705-49ba-98b2-d94b27ad90b7 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:12.673497 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-e7526430-b705-49ba-98b2-d94b27ad90b7 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Getting quotas for project 8e9e827220104db5a73cf01d58418648. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:57:12.678292 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-e7526430-b705-49ba-98b2-d94b27ad90b7 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Getting quotas for user d6824c7c97414a72bec98f8c819356ff and project 8e9e827220104db5a73cf01d58418648. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:57:12.690692 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e7526430-b705-49ba-98b2-d94b27ad90b7 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Going to run 1 instances... {{(pid=117443) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:57:12.693216 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e7526430-b705-49ba-98b2-d94b27ad90b7 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2f37ffa-db20-478d-84c0-b429a987933c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:57:12.744365 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e7526430-b705-49ba-98b2-d94b27ad90b7 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.032993 Jun 16 14:57:12.745309 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 116/221] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 14:57:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 14:57:12.755660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-53dd7ff1-5f93-451d-ba32-926bbe071f1a tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:12.756342 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-53dd7ff1-5f93-451d-ba32-926bbe071f1a tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:12.891991 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-53dd7ff1-5f93-451d-ba32-926bbe071f1a tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:12.917876 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-53dd7ff1-5f93-451d-ba32-926bbe071f1a tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1213 microversion: 2.1 time: 0.165969 Jun 16 14:57:12.919205 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 106/222] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:12 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1213 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:13.209496 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4cef22cc-2742-491c-842c-7fb5032f81f6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-626548250", "imageRef": "f2f37ffa-db20-478d-84c0-b429a987933c", "flavorRef": "452", "networks": [{"uuid": "a74a8470-0393-4315-802c-8d2ab5234a49"}]}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:13.300347 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.network.neutron [None req-4cef22cc-2742-491c-842c-7fb5032f81f6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] validate_networks() for [('a74a8470-0393-4315-802c-8d2ab5234a49', None, None, None, None, None)] {{(pid=117443) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:57:13.530448 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-039163dc-5996-4fb6-9d06-5a8f92394f8e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:13.531366 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-039163dc-5996-4fb6-9d06-5a8f92394f8e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:13.541272 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-039163dc-5996-4fb6-9d06-5a8f92394f8e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:13.541729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-039163dc-5996-4fb6-9d06-5a8f92394f8e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:13.542593 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-039163dc-5996-4fb6-9d06-5a8f92394f8e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:13.543026 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-039163dc-5996-4fb6-9d06-5a8f92394f8e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:13.883585 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-039163dc-5996-4fb6-9d06-5a8f92394f8e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:13.896063 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-039163dc-5996-4fb6-9d06-5a8f92394f8e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.372405 Jun 16 14:57:13.896781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 107/223] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:13 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:13.937499 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7bcbbb5e-2a9d-43e1-9bf6-f7e92f72a6b3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:13.939297 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7bcbbb5e-2a9d-43e1-9bf6-f7e92f72a6b3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:13.946243 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7bcbbb5e-2a9d-43e1-9bf6-f7e92f72a6b3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:13.946824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7bcbbb5e-2a9d-43e1-9bf6-f7e92f72a6b3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:13.947761 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7bcbbb5e-2a9d-43e1-9bf6-f7e92f72a6b3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:13.948724 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7bcbbb5e-2a9d-43e1-9bf6-f7e92f72a6b3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:14.383397 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7bcbbb5e-2a9d-43e1-9bf6-f7e92f72a6b3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:14.400389 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7bcbbb5e-2a9d-43e1-9bf6-f7e92f72a6b3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1265 microversion: 2.1 time: 0.464690 Jun 16 14:57:14.400389 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 108/224] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:13 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1265 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:14.509946 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-4cef22cc-2742-491c-842c-7fb5032f81f6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Flavor limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:57:14.510371 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-4cef22cc-2742-491c-842c-7fb5032f81f6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Image limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:57:14.511537 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-4cef22cc-2742-491c-842c-7fb5032f81f6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Flavor pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:57:14.514094 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-4cef22cc-2742-491c-842c-7fb5032f81f6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Image pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:57:14.514537 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-4cef22cc-2742-491c-842c-7fb5032f81f6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:57:14.527794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4cef22cc-2742-491c-842c-7fb5032f81f6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:14.528270 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4cef22cc-2742-491c-842c-7fb5032f81f6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:14.529222 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4cef22cc-2742-491c-842c-7fb5032f81f6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:14.529858 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4cef22cc-2742-491c-842c-7fb5032f81f6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:14.562522 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-4cef22cc-2742-491c-842c-7fb5032f81f6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Getting quotas for project cef1f9d9b1a74f84a3cdda0feb12ad0c. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:57:14.568188 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-4cef22cc-2742-491c-842c-7fb5032f81f6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Getting quotas for user 4b6c7f2af8fa4f68a80d006105a96ee3 and project cef1f9d9b1a74f84a3cdda0feb12ad0c. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:57:14.583335 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4cef22cc-2742-491c-842c-7fb5032f81f6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Going to run 1 instances... {{(pid=117443) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:57:14.587007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4cef22cc-2742-491c-842c-7fb5032f81f6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2f37ffa-db20-478d-84c0-b429a987933c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:57:14.666754 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4cef22cc-2742-491c-842c-7fb5032f81f6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.461635 Jun 16 14:57:14.668929 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 117/225] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 14:57:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:57:14.679376 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3839dbf9-a5a3-46bb-b730-dd031b597bbf tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:14.680293 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3839dbf9-a5a3-46bb-b730-dd031b597bbf tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:14.863325 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3839dbf9-a5a3-46bb-b730-dd031b597bbf tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:14.873390 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3839dbf9-a5a3-46bb-b730-dd031b597bbf tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1218 microversion: 2.1 time: 0.198170 Jun 16 14:57:14.873981 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 109/226] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:14 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1218 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:14.913941 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d9e76a34-63c2-4264-ae16-ca799ba4f528 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:14.915105 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d9e76a34-63c2-4264-ae16-ca799ba4f528 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:14.930282 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d9e76a34-63c2-4264-ae16-ca799ba4f528 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:14.932234 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d9e76a34-63c2-4264-ae16-ca799ba4f528 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:14.935237 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d9e76a34-63c2-4264-ae16-ca799ba4f528 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:14.936148 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d9e76a34-63c2-4264-ae16-ca799ba4f528 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:15.231639 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d9e76a34-63c2-4264-ae16-ca799ba4f528 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:15.242016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d9e76a34-63c2-4264-ae16-ca799ba4f528 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.332091 Jun 16 14:57:15.242987 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 118/227] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:14 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:15.416600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-96ff2a73-4862-4851-bd24-aaed6ade4893 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:15.417213 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-96ff2a73-4862-4851-bd24-aaed6ade4893 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:15.426452 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-96ff2a73-4862-4851-bd24-aaed6ade4893 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:15.428788 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-96ff2a73-4862-4851-bd24-aaed6ade4893 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:15.431100 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-96ff2a73-4862-4851-bd24-aaed6ade4893 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:15.431948 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-96ff2a73-4862-4851-bd24-aaed6ade4893 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:15.521035 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-96ff2a73-4862-4851-bd24-aaed6ade4893 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:15.531519 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-96ff2a73-4862-4851-bd24-aaed6ade4893 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1271 microversion: 2.1 time: 0.119272 Jun 16 14:57:15.532870 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 110/228] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:15 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1271 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:15.892235 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-24b7e170-1c41-4b6e-92c4-cddb97743fde tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:15.892833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-24b7e170-1c41-4b6e-92c4-cddb97743fde tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:15.913541 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-24b7e170-1c41-4b6e-92c4-cddb97743fde tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:15.914307 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-24b7e170-1c41-4b6e-92c4-cddb97743fde tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:15.915321 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-24b7e170-1c41-4b6e-92c4-cddb97743fde tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:15.916295 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-24b7e170-1c41-4b6e-92c4-cddb97743fde tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:16.015011 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-24b7e170-1c41-4b6e-92c4-cddb97743fde tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:16.038234 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-24b7e170-1c41-4b6e-92c4-cddb97743fde tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1270 microversion: 2.1 time: 0.151493 Jun 16 14:57:16.041191 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 119/229] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:15 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:16.261055 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-59e1a942-4636-4425-8399-a410b8d18b47 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:16.262311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-59e1a942-4636-4425-8399-a410b8d18b47 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:16.270428 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-59e1a942-4636-4425-8399-a410b8d18b47 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:16.271220 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-59e1a942-4636-4425-8399-a410b8d18b47 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:16.272281 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-59e1a942-4636-4425-8399-a410b8d18b47 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:16.272931 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-59e1a942-4636-4425-8399-a410b8d18b47 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:16.550036 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-85ffb01a-dd9e-423a-8771-6e0ce3fa2510 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:16.550740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-85ffb01a-dd9e-423a-8771-6e0ce3fa2510 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:16.552957 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:16.567728 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-85ffb01a-dd9e-423a-8771-6e0ce3fa2510 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:16.568180 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-85ffb01a-dd9e-423a-8771-6e0ce3fa2510 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:16.569073 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-85ffb01a-dd9e-423a-8771-6e0ce3fa2510 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:16.569539 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-85ffb01a-dd9e-423a-8771-6e0ce3fa2510 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:16.709873 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-59e1a942-4636-4425-8399-a410b8d18b47 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:16.720099 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-59e1a942-4636-4425-8399-a410b8d18b47 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.462867 Jun 16 14:57:16.721025 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 111/230] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:16 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:16.979250 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-85ffb01a-dd9e-423a-8771-6e0ce3fa2510 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:16.989563 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-85ffb01a-dd9e-423a-8771-6e0ce3fa2510 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1313 microversion: 2.1 time: 0.444027 Jun 16 14:57:16.990369 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 120/231] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:16 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:17.058979 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-285e4ae7-198d-4697-b747-f8704c1bc381 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:17.059599 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-285e4ae7-198d-4697-b747-f8704c1bc381 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:17.066562 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-285e4ae7-198d-4697-b747-f8704c1bc381 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:17.067437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-285e4ae7-198d-4697-b747-f8704c1bc381 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:17.068255 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-285e4ae7-198d-4697-b747-f8704c1bc381 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:17.069069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-285e4ae7-198d-4697-b747-f8704c1bc381 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:17.204003 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-285e4ae7-198d-4697-b747-f8704c1bc381 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:17.215327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-285e4ae7-198d-4697-b747-f8704c1bc381 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1276 microversion: 2.1 time: 0.160326 Jun 16 14:57:17.215957 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 112/232] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:17 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:17.694921 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-45c6724f-52dd-47a2-8f23-cc1412aa4b27 req-0913fd50-c934-403f-aa08-d883ba027855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66e9804b-1fee-4e34-a1fc-0824fc3e69c8", "tag": "918da2f2-f872-42f2-9d05-0edde2fec6b2"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:17.714190 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-45c6724f-52dd-47a2-8f23-cc1412aa4b27 req-0913fd50-c934-403f-aa08-d883ba027855 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:17.718785 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-45c6724f-52dd-47a2-8f23-cc1412aa4b27 req-0913fd50-c934-403f-aa08-d883ba027855 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:17.743128 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c211c330-4939-4e3a-9c9b-e0232389c473 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:17.748131 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c211c330-4939-4e3a-9c9b-e0232389c473 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:17.767053 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c211c330-4939-4e3a-9c9b-e0232389c473 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:17.769288 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c211c330-4939-4e3a-9c9b-e0232389c473 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:17.773082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c211c330-4939-4e3a-9c9b-e0232389c473 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:17.774888 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c211c330-4939-4e3a-9c9b-e0232389c473 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:17.781150 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-45c6724f-52dd-47a2-8f23-cc1412aa4b27 req-0913fd50-c934-403f-aa08-d883ba027855 service nova] Creating event network-changed:918da2f2-f872-42f2-9d05-0edde2fec6b2 for instance 66e9804b-1fee-4e34-a1fc-0824fc3e69c8 on hv-cinder-83716 Jun 16 14:57:17.795476 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-45c6724f-52dd-47a2-8f23-cc1412aa4b27 req-0913fd50-c934-403f-aa08-d883ba027855 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105020 Jun 16 14:57:17.801359 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 121/233] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:18.007640 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-941f43ee-b90c-4b12-a343-a8a384217ea3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:18.009249 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-941f43ee-b90c-4b12-a343-a8a384217ea3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:18.016525 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-941f43ee-b90c-4b12-a343-a8a384217ea3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:18.017284 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-941f43ee-b90c-4b12-a343-a8a384217ea3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:18.018358 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-941f43ee-b90c-4b12-a343-a8a384217ea3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:18.019169 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-941f43ee-b90c-4b12-a343-a8a384217ea3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:18.176837 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c211c330-4939-4e3a-9c9b-e0232389c473 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:18.184925 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c211c330-4939-4e3a-9c9b-e0232389c473 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.451481 Jun 16 14:57:18.186076 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 113/234] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:17 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:18.232746 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-bc404321-039f-41bd-8369-471e5b589c35 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:18.233357 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-bc404321-039f-41bd-8369-471e5b589c35 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:18.239317 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bc404321-039f-41bd-8369-471e5b589c35 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:18.239993 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bc404321-039f-41bd-8369-471e5b589c35 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:18.240931 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bc404321-039f-41bd-8369-471e5b589c35 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:18.241510 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bc404321-039f-41bd-8369-471e5b589c35 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:18.693035 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-941f43ee-b90c-4b12-a343-a8a384217ea3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:18.698961 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:18.717561 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-941f43ee-b90c-4b12-a343-a8a384217ea3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1313 microversion: 2.1 time: 0.712923 Jun 16 14:57:18.719888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 122/235] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:18 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1313 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:18.976835 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-bc404321-039f-41bd-8369-471e5b589c35 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:18.988770 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-bc404321-039f-41bd-8369-471e5b589c35 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1318 microversion: 2.1 time: 0.758989 Jun 16 14:57:18.988770 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 114/236] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:18 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1318 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:19.202846 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6872bb7f-2929-47a3-b670-dd3b7d5aa470 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:19.204426 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6872bb7f-2929-47a3-b670-dd3b7d5aa470 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:19.214884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6872bb7f-2929-47a3-b670-dd3b7d5aa470 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:19.215598 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6872bb7f-2929-47a3-b670-dd3b7d5aa470 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:19.216400 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6872bb7f-2929-47a3-b670-dd3b7d5aa470 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:19.216975 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6872bb7f-2929-47a3-b670-dd3b7d5aa470 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:19.625510 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6872bb7f-2929-47a3-b670-dd3b7d5aa470 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:19.636277 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6872bb7f-2929-47a3-b670-dd3b7d5aa470 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.437664 Jun 16 14:57:19.637536 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 123/237] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:19 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:19.738745 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1cbca711-c90f-487b-8b2d-ff2c5ef342eb tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:19.740477 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1cbca711-c90f-487b-8b2d-ff2c5ef342eb tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:19.749759 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1cbca711-c90f-487b-8b2d-ff2c5ef342eb tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:19.750490 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1cbca711-c90f-487b-8b2d-ff2c5ef342eb tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:19.751600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1cbca711-c90f-487b-8b2d-ff2c5ef342eb tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:19.752198 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1cbca711-c90f-487b-8b2d-ff2c5ef342eb tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:19.819815 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-6bbdb7ea-0f7e-495f-b731-12729bbe49c5 req-926701c2-b3d0-45ae-872b-d68e4222961b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34f1cea3-93d7-4092-9cf2-814af9af3984", "tag": "f1f48c07-1fe5-4833-8ce2-fc083a91f73f"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:19.828796 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-6bbdb7ea-0f7e-495f-b731-12729bbe49c5 req-926701c2-b3d0-45ae-872b-d68e4222961b service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:19.829577 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-6bbdb7ea-0f7e-495f-b731-12729bbe49c5 req-926701c2-b3d0-45ae-872b-d68e4222961b service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:19.843875 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-6bbdb7ea-0f7e-495f-b731-12729bbe49c5 req-926701c2-b3d0-45ae-872b-d68e4222961b service nova] Creating event network-changed:f1f48c07-1fe5-4833-8ce2-fc083a91f73f for instance 34f1cea3-93d7-4092-9cf2-814af9af3984 on hv-cinder-83716 Jun 16 14:57:19.849550 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-6bbdb7ea-0f7e-495f-b731-12729bbe49c5 req-926701c2-b3d0-45ae-872b-d68e4222961b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033370 Jun 16 14:57:19.850524 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 124/238] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:19.931776 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1cbca711-c90f-487b-8b2d-ff2c5ef342eb tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:19.939825 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1cbca711-c90f-487b-8b2d-ff2c5ef342eb tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1313 microversion: 2.1 time: 0.207005 Jun 16 14:57:19.940440 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 115/239] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:19 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:20.006460 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3676c1c4-69b9-43bb-9ac0-af59fc05c339 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:20.007150 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-3676c1c4-69b9-43bb-9ac0-af59fc05c339 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:20.013532 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3676c1c4-69b9-43bb-9ac0-af59fc05c339 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:20.013992 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3676c1c4-69b9-43bb-9ac0-af59fc05c339 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:20.014892 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3676c1c4-69b9-43bb-9ac0-af59fc05c339 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:20.015549 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3676c1c4-69b9-43bb-9ac0-af59fc05c339 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:20.152744 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3676c1c4-69b9-43bb-9ac0-af59fc05c339 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:20.161772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3676c1c4-69b9-43bb-9ac0-af59fc05c339 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1318 microversion: 2.1 time: 0.159278 Jun 16 14:57:20.162427 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 125/240] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:20 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:20.653377 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-540dd726-21af-4f85-9228-35ebb3065cab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:20.654075 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-540dd726-21af-4f85-9228-35ebb3065cab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:20.661841 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-540dd726-21af-4f85-9228-35ebb3065cab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:20.662555 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-540dd726-21af-4f85-9228-35ebb3065cab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:20.668509 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-540dd726-21af-4f85-9228-35ebb3065cab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:20.668509 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-540dd726-21af-4f85-9228-35ebb3065cab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:20.958507 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-fee1206f-0866-41a2-ac34-8b61a0e5e1df tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:20.959389 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-fee1206f-0866-41a2-ac34-8b61a0e5e1df tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:20.966380 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fee1206f-0866-41a2-ac34-8b61a0e5e1df tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:20.966981 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fee1206f-0866-41a2-ac34-8b61a0e5e1df tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:20.967720 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fee1206f-0866-41a2-ac34-8b61a0e5e1df tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:20.968322 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fee1206f-0866-41a2-ac34-8b61a0e5e1df tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:21.142299 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-540dd726-21af-4f85-9228-35ebb3065cab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:21.150065 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-540dd726-21af-4f85-9228-35ebb3065cab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.500427 Jun 16 14:57:21.150638 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 116/241] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:20 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:21.178872 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-49bc0d01-3715-40fe-94b6-3ee20582067d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:21.179485 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-49bc0d01-3715-40fe-94b6-3ee20582067d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:21.185859 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-49bc0d01-3715-40fe-94b6-3ee20582067d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:21.186308 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-49bc0d01-3715-40fe-94b6-3ee20582067d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:21.187077 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-49bc0d01-3715-40fe-94b6-3ee20582067d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:21.188210 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-49bc0d01-3715-40fe-94b6-3ee20582067d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:21.511983 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fee1206f-0866-41a2-ac34-8b61a0e5e1df tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:21.522234 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-fee1206f-0866-41a2-ac34-8b61a0e5e1df tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1313 microversion: 2.1 time: 0.568612 Jun 16 14:57:21.533743 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 126/242] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:20 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1313 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:21.599258 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-49bc0d01-3715-40fe-94b6-3ee20582067d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:21.607030 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-49bc0d01-3715-40fe-94b6-3ee20582067d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1318 microversion: 2.1 time: 0.432122 Jun 16 14:57:21.607241 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 117/243] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:21 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:22.167813 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4f1a1561-c2d3-4823-b04e-a5bc77f1787f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:22.168888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4f1a1561-c2d3-4823-b04e-a5bc77f1787f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:22.177318 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4f1a1561-c2d3-4823-b04e-a5bc77f1787f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:22.177768 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4f1a1561-c2d3-4823-b04e-a5bc77f1787f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:22.178533 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4f1a1561-c2d3-4823-b04e-a5bc77f1787f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:22.179140 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4f1a1561-c2d3-4823-b04e-a5bc77f1787f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:22.324215 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4f1a1561-c2d3-4823-b04e-a5bc77f1787f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:22.331968 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4f1a1561-c2d3-4823-b04e-a5bc77f1787f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.168048 Jun 16 14:57:22.332864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 127/244] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:22 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:22.540658 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6c3b2bfc-f3ef-4bd9-affd-f8b32620bf40 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:22.541699 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6c3b2bfc-f3ef-4bd9-affd-f8b32620bf40 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:22.550122 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6c3b2bfc-f3ef-4bd9-affd-f8b32620bf40 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:22.550568 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6c3b2bfc-f3ef-4bd9-affd-f8b32620bf40 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:22.551365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6c3b2bfc-f3ef-4bd9-affd-f8b32620bf40 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:22.551880 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6c3b2bfc-f3ef-4bd9-affd-f8b32620bf40 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:22.623781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4fc2f34c-3703-4878-a735-48c3366446f0 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:22.624392 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4fc2f34c-3703-4878-a735-48c3366446f0 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:22.635627 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4fc2f34c-3703-4878-a735-48c3366446f0 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:22.636505 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4fc2f34c-3703-4878-a735-48c3366446f0 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:22.637260 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4fc2f34c-3703-4878-a735-48c3366446f0 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:22.637666 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4fc2f34c-3703-4878-a735-48c3366446f0 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:22.758926 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6c3b2bfc-f3ef-4bd9-affd-f8b32620bf40 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:22.770653 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6c3b2bfc-f3ef-4bd9-affd-f8b32620bf40 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1313 microversion: 2.1 time: 0.234363 Jun 16 14:57:22.771345 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 118/245] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:22 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:22.828706 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4fc2f34c-3703-4878-a735-48c3366446f0 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:22.836841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4fc2f34c-3703-4878-a735-48c3366446f0 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1318 microversion: 2.1 time: 0.216892 Jun 16 14:57:22.837405 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 128/246] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:22 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:23.350922 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-53285a78-fc48-4dfe-bcdb-c131e0c6efac tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:23.352193 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-53285a78-fc48-4dfe-bcdb-c131e0c6efac tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:23.361082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-53285a78-fc48-4dfe-bcdb-c131e0c6efac tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:23.361538 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-53285a78-fc48-4dfe-bcdb-c131e0c6efac tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:23.362336 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-53285a78-fc48-4dfe-bcdb-c131e0c6efac tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:23.362777 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-53285a78-fc48-4dfe-bcdb-c131e0c6efac tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:23.540488 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-53285a78-fc48-4dfe-bcdb-c131e0c6efac tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:23.551202 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-53285a78-fc48-4dfe-bcdb-c131e0c6efac tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.205441 Jun 16 14:57:23.552425 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 119/247] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:23 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:23.787612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a91e6f56-a57f-4c25-a839-cd10a5ba7a1e tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:23.788251 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a91e6f56-a57f-4c25-a839-cd10a5ba7a1e tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:23.794259 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a91e6f56-a57f-4c25-a839-cd10a5ba7a1e tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:23.794704 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a91e6f56-a57f-4c25-a839-cd10a5ba7a1e tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:23.795463 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a91e6f56-a57f-4c25-a839-cd10a5ba7a1e tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:23.795964 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a91e6f56-a57f-4c25-a839-cd10a5ba7a1e tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:23.854774 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ca7bb832-6aa2-43c6-9531-d9f04c62d657 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:23.855380 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ca7bb832-6aa2-43c6-9531-d9f04c62d657 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:23.862638 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca7bb832-6aa2-43c6-9531-d9f04c62d657 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:23.863266 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca7bb832-6aa2-43c6-9531-d9f04c62d657 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:23.864072 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca7bb832-6aa2-43c6-9531-d9f04c62d657 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:23.864497 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca7bb832-6aa2-43c6-9531-d9f04c62d657 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:24.033195 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a91e6f56-a57f-4c25-a839-cd10a5ba7a1e tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:24.051966 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a91e6f56-a57f-4c25-a839-cd10a5ba7a1e tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1313 microversion: 2.1 time: 0.268190 Jun 16 14:57:24.056664 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 129/248] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:23 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:24.068527 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ca7bb832-6aa2-43c6-9531-d9f04c62d657 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:24.076455 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ca7bb832-6aa2-43c6-9531-d9f04c62d657 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1318 microversion: 2.1 time: 0.226027 Jun 16 14:57:24.077138 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 120/249] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:23 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:24.570708 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4937e751-5397-4ff8-a7e6-0846f0d1058a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:24.571312 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4937e751-5397-4ff8-a7e6-0846f0d1058a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:24.574258 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=4 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:24.577911 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4937e751-5397-4ff8-a7e6-0846f0d1058a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:24.578383 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4937e751-5397-4ff8-a7e6-0846f0d1058a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:24.579149 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4937e751-5397-4ff8-a7e6-0846f0d1058a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:24.579769 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4937e751-5397-4ff8-a7e6-0846f0d1058a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:24.580531 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=12 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:24.757169 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4937e751-5397-4ff8-a7e6-0846f0d1058a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:24.769503 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4937e751-5397-4ff8-a7e6-0846f0d1058a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.202111 Jun 16 14:57:24.770106 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 130/250] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:24 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:24.870181 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-722f1e7c-082f-4425-b7d3-0a3304e3bc9f req-0e762f33-93d4-4310-93ea-4a050c5bb70b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66e9804b-1fee-4e34-a1fc-0824fc3e69c8", "name": "network-vif-plugged", "status": "completed", "tag": "918da2f2-f872-42f2-9d05-0edde2fec6b2"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:24.876949 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=4 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:24.887474 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-722f1e7c-082f-4425-b7d3-0a3304e3bc9f req-0e762f33-93d4-4310-93ea-4a050c5bb70b service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:24.889168 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-722f1e7c-082f-4425-b7d3-0a3304e3bc9f req-0e762f33-93d4-4310-93ea-4a050c5bb70b service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:24.908558 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-722f1e7c-082f-4425-b7d3-0a3304e3bc9f req-0e762f33-93d4-4310-93ea-4a050c5bb70b service nova] Creating event network-vif-plugged:918da2f2-f872-42f2-9d05-0edde2fec6b2 for instance 66e9804b-1fee-4e34-a1fc-0824fc3e69c8 on hv-cinder-83716 Jun 16 14:57:24.914965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-722f1e7c-082f-4425-b7d3-0a3304e3bc9f req-0e762f33-93d4-4310-93ea-4a050c5bb70b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049529 Jun 16 14:57:24.915953 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 121/251] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:25.074346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7eb5921e-063d-4454-b1f3-af81c76e9353 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:25.075229 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7eb5921e-063d-4454-b1f3-af81c76e9353 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:25.085904 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7eb5921e-063d-4454-b1f3-af81c76e9353 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:25.086632 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7eb5921e-063d-4454-b1f3-af81c76e9353 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:25.088322 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7eb5921e-063d-4454-b1f3-af81c76e9353 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:25.097815 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2d52951c-1619-40e9-827e-f548fe832a00 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:25.098856 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2d52951c-1619-40e9-827e-f548fe832a00 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:25.102397 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7eb5921e-063d-4454-b1f3-af81c76e9353 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:25.115296 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2d52951c-1619-40e9-827e-f548fe832a00 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:25.115836 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2d52951c-1619-40e9-827e-f548fe832a00 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:25.116761 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2d52951c-1619-40e9-827e-f548fe832a00 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:25.117218 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2d52951c-1619-40e9-827e-f548fe832a00 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:25.404700 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7eb5921e-063d-4454-b1f3-af81c76e9353 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:25.409795 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2d52951c-1619-40e9-827e-f548fe832a00 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:25.416095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7eb5921e-063d-4454-b1f3-af81c76e9353 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1313 microversion: 2.1 time: 0.349403 Jun 16 14:57:25.417433 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 131/252] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:25 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:25.429732 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2d52951c-1619-40e9-827e-f548fe832a00 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1318 microversion: 2.1 time: 0.339072 Jun 16 14:57:25.430314 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 122/253] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:25 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:25.787381 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-9b283316-6913-417c-a723-23a54afb7c79 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:25.788121 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-9b283316-6913-417c-a723-23a54afb7c79 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:25.794361 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9b283316-6913-417c-a723-23a54afb7c79 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:25.794740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9b283316-6913-417c-a723-23a54afb7c79 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:25.795497 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9b283316-6913-417c-a723-23a54afb7c79 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:25.796206 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9b283316-6913-417c-a723-23a54afb7c79 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:25.943370 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-9b283316-6913-417c-a723-23a54afb7c79 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:25.951357 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-9b283316-6913-417c-a723-23a54afb7c79 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.168404 Jun 16 14:57:25.951943 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 132/254] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:25 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:26.434300 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ff3e9f73-0cc5-42b1-94e0-8b7a932b3b10 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:26.434943 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ff3e9f73-0cc5-42b1-94e0-8b7a932b3b10 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:26.441547 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ff3e9f73-0cc5-42b1-94e0-8b7a932b3b10 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:26.442004 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ff3e9f73-0cc5-42b1-94e0-8b7a932b3b10 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:26.442783 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ff3e9f73-0cc5-42b1-94e0-8b7a932b3b10 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:26.443222 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ff3e9f73-0cc5-42b1-94e0-8b7a932b3b10 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:26.447898 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a6219fbb-5aaa-4177-ae60-812fff6de33b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:26.448498 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a6219fbb-5aaa-4177-ae60-812fff6de33b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:26.455130 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a6219fbb-5aaa-4177-ae60-812fff6de33b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:26.455628 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a6219fbb-5aaa-4177-ae60-812fff6de33b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:26.456422 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a6219fbb-5aaa-4177-ae60-812fff6de33b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:26.456854 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a6219fbb-5aaa-4177-ae60-812fff6de33b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:26.672988 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ff3e9f73-0cc5-42b1-94e0-8b7a932b3b10 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:26.680141 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a6219fbb-5aaa-4177-ae60-812fff6de33b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:26.686241 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ff3e9f73-0cc5-42b1-94e0-8b7a932b3b10 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1313 microversion: 2.1 time: 0.255634 Jun 16 14:57:26.692033 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 123/255] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:26 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:26.708277 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a6219fbb-5aaa-4177-ae60-812fff6de33b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1318 microversion: 2.1 time: 0.263660 Jun 16 14:57:26.709847 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 133/256] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:26 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:26.938674 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-1eef32d6-8aea-44af-b1ea-80227314ddfb req-7206a447-8ce2-4350-8155-92cb826cfca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f1cea3-93d7-4092-9cf2-814af9af3984", "name": "network-vif-plugged", "status": "completed", "tag": "f1f48c07-1fe5-4833-8ce2-fc083a91f73f"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:26.946876 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-1eef32d6-8aea-44af-b1ea-80227314ddfb req-7206a447-8ce2-4350-8155-92cb826cfca3 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:26.947308 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-1eef32d6-8aea-44af-b1ea-80227314ddfb req-7206a447-8ce2-4350-8155-92cb826cfca3 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:26.959351 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-1eef32d6-8aea-44af-b1ea-80227314ddfb req-7206a447-8ce2-4350-8155-92cb826cfca3 service nova] Creating event network-vif-plugged:f1f48c07-1fe5-4833-8ce2-fc083a91f73f for instance 34f1cea3-93d7-4092-9cf2-814af9af3984 on hv-cinder-83716 Jun 16 14:57:26.965120 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-1eef32d6-8aea-44af-b1ea-80227314ddfb req-7206a447-8ce2-4350-8155-92cb826cfca3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030486 Jun 16 14:57:26.965772 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 124/257] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:26.973411 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6103fe4a-a74d-4a67-a364-23495255729c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:26.973411 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6103fe4a-a74d-4a67-a364-23495255729c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:26.976555 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6103fe4a-a74d-4a67-a364-23495255729c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:26.976999 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6103fe4a-a74d-4a67-a364-23495255729c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:26.977762 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6103fe4a-a74d-4a67-a364-23495255729c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:26.978189 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6103fe4a-a74d-4a67-a364-23495255729c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:27.127069 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6103fe4a-a74d-4a67-a364-23495255729c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:27.134720 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6103fe4a-a74d-4a67-a364-23495255729c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.169688 Jun 16 14:57:27.135378 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 134/258] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:26 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:27.712400 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6f959c5b-4df7-4dc0-ac7e-fdfca5746f2c tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:27.713488 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6f959c5b-4df7-4dc0-ac7e-fdfca5746f2c tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:27.722635 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6f959c5b-4df7-4dc0-ac7e-fdfca5746f2c tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:27.723079 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6f959c5b-4df7-4dc0-ac7e-fdfca5746f2c tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:27.724154 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6f959c5b-4df7-4dc0-ac7e-fdfca5746f2c tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:27.724890 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6f959c5b-4df7-4dc0-ac7e-fdfca5746f2c tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:27.726638 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4b720a4e-cb60-4cda-8459-24f4c544cc31 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:27.727249 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4b720a4e-cb60-4cda-8459-24f4c544cc31 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:27.731306 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=100 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:27.735899 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4b720a4e-cb60-4cda-8459-24f4c544cc31 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:27.736756 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4b720a4e-cb60-4cda-8459-24f4c544cc31 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:27.738247 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4b720a4e-cb60-4cda-8459-24f4c544cc31 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:27.738725 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4b720a4e-cb60-4cda-8459-24f4c544cc31 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:27.940306 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6f959c5b-4df7-4dc0-ac7e-fdfca5746f2c tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:27.943254 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4b720a4e-cb60-4cda-8459-24f4c544cc31 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:27.948749 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6f959c5b-4df7-4dc0-ac7e-fdfca5746f2c tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1497 microversion: 2.1 time: 0.242704 Jun 16 14:57:27.949116 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 125/259] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:27 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1497 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:27.952518 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4b720a4e-cb60-4cda-8459-24f4c544cc31 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1318 microversion: 2.1 time: 0.229214 Jun 16 14:57:27.952518 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 135/260] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:27 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:28.154149 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-97be95f7-e255-44be-a23f-08f3bea6a825 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:28.154757 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-97be95f7-e255-44be-a23f-08f3bea6a825 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:28.162605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-97be95f7-e255-44be-a23f-08f3bea6a825 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:28.163050 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-97be95f7-e255-44be-a23f-08f3bea6a825 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:28.163894 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-97be95f7-e255-44be-a23f-08f3bea6a825 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:28.164448 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-97be95f7-e255-44be-a23f-08f3bea6a825 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:28.303772 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-97be95f7-e255-44be-a23f-08f3bea6a825 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:28.311714 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-97be95f7-e255-44be-a23f-08f3bea6a825 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.162979 Jun 16 14:57:28.312271 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 126/261] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:28 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:28.969633 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f8fe9eeb-d894-40cb-b51a-806875ef970f tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:28.970136 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f8fe9eeb-d894-40cb-b51a-806875ef970f tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:28.976172 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f8fe9eeb-d894-40cb-b51a-806875ef970f tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:28.976621 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f8fe9eeb-d894-40cb-b51a-806875ef970f tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:28.977489 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f8fe9eeb-d894-40cb-b51a-806875ef970f tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:28.977941 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f8fe9eeb-d894-40cb-b51a-806875ef970f tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:29.105207 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f8fe9eeb-d894-40cb-b51a-806875ef970f tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:29.113135 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f8fe9eeb-d894-40cb-b51a-806875ef970f tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1318 microversion: 2.1 time: 0.147962 Jun 16 14:57:29.113694 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 136/262] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:28 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:29.330000 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7b9cdbf2-1d51-4621-8481-948f44200de8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:29.330581 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7b9cdbf2-1d51-4621-8481-948f44200de8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:29.338182 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b9cdbf2-1d51-4621-8481-948f44200de8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:29.338618 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b9cdbf2-1d51-4621-8481-948f44200de8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:29.339457 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b9cdbf2-1d51-4621-8481-948f44200de8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:29.339920 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b9cdbf2-1d51-4621-8481-948f44200de8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:29.709964 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7b9cdbf2-1d51-4621-8481-948f44200de8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:29.717782 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7b9cdbf2-1d51-4621-8481-948f44200de8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.392396 Jun 16 14:57:29.718341 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 127/263] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:29 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:30.130321 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ad432f04-8b11-4fbd-84f6-2b08fd98186e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:30.130921 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ad432f04-8b11-4fbd-84f6-2b08fd98186e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:30.136992 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ad432f04-8b11-4fbd-84f6-2b08fd98186e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:30.137437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ad432f04-8b11-4fbd-84f6-2b08fd98186e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:30.138180 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ad432f04-8b11-4fbd-84f6-2b08fd98186e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:30.138608 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ad432f04-8b11-4fbd-84f6-2b08fd98186e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:30.269886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ad432f04-8b11-4fbd-84f6-2b08fd98186e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:30.277295 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ad432f04-8b11-4fbd-84f6-2b08fd98186e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1318 microversion: 2.1 time: 0.150909 Jun 16 14:57:30.277845 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 137/264] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:30 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:30.735331 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-fbb2bc0b-cafe-40c6-bdf5-9155ad484785 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:30.735959 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-fbb2bc0b-cafe-40c6-bdf5-9155ad484785 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:30.742465 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fbb2bc0b-cafe-40c6-bdf5-9155ad484785 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:30.742913 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fbb2bc0b-cafe-40c6-bdf5-9155ad484785 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:30.743688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fbb2bc0b-cafe-40c6-bdf5-9155ad484785 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:30.744139 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fbb2bc0b-cafe-40c6-bdf5-9155ad484785 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:30.876808 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fbb2bc0b-cafe-40c6-bdf5-9155ad484785 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:30.884423 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-fbb2bc0b-cafe-40c6-bdf5-9155ad484785 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.153637 Jun 16 14:57:30.884984 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 128/265] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:30 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:31.294396 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-02cffe6c-4f11-493a-8a99-6698d7dd9fe7 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:31.294932 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-02cffe6c-4f11-493a-8a99-6698d7dd9fe7 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:31.301014 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-02cffe6c-4f11-493a-8a99-6698d7dd9fe7 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:31.301455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-02cffe6c-4f11-493a-8a99-6698d7dd9fe7 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:31.302215 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-02cffe6c-4f11-493a-8a99-6698d7dd9fe7 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:31.302645 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-02cffe6c-4f11-493a-8a99-6698d7dd9fe7 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:31.432419 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-02cffe6c-4f11-493a-8a99-6698d7dd9fe7 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:31.440464 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-02cffe6c-4f11-493a-8a99-6698d7dd9fe7 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1318 microversion: 2.1 time: 0.150019 Jun 16 14:57:31.441024 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 138/266] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:31 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:31.642624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-662255fd-ad6c-41fe-a54b-62451c537c11 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:31.643201 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-662255fd-ad6c-41fe-a54b-62451c537c11 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:31.649631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-662255fd-ad6c-41fe-a54b-62451c537c11 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:31.650076 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-662255fd-ad6c-41fe-a54b-62451c537c11 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:31.650829 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-662255fd-ad6c-41fe-a54b-62451c537c11 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:31.651269 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-662255fd-ad6c-41fe-a54b-62451c537c11 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:31.677216 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-662255fd-ad6c-41fe-a54b-62451c537c11 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:57:31.767235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-662255fd-ad6c-41fe-a54b-62451c537c11 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "DELETE /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 204 len: 0 microversion: 2.1 time: 0.129796 Jun 16 14:57:31.768184 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 129/267] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 14:57:31 2022] DELETE /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:57:31.776739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4f6a4957-6e07-4adf-96e1-a50e262544c9 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:31.777458 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4f6a4957-6e07-4adf-96e1-a50e262544c9 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:31.783903 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4f6a4957-6e07-4adf-96e1-a50e262544c9 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:31.784350 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4f6a4957-6e07-4adf-96e1-a50e262544c9 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:31.785115 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4f6a4957-6e07-4adf-96e1-a50e262544c9 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:31.786280 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4f6a4957-6e07-4adf-96e1-a50e262544c9 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:31.901417 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-12e86839-e7a0-49f5-9dee-5a93262fc656 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:31.902118 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-12e86839-e7a0-49f5-9dee-5a93262fc656 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:31.908448 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-12e86839-e7a0-49f5-9dee-5a93262fc656 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:31.908914 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-12e86839-e7a0-49f5-9dee-5a93262fc656 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:31.909683 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-12e86839-e7a0-49f5-9dee-5a93262fc656 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:31.910118 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-12e86839-e7a0-49f5-9dee-5a93262fc656 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:31.925401 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4f6a4957-6e07-4adf-96e1-a50e262544c9 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:31.933332 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4f6a4957-6e07-4adf-96e1-a50e262544c9 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1503 microversion: 2.1 time: 0.160850 Jun 16 14:57:31.933903 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 139/268] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:31 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:32.046090 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-12e86839-e7a0-49f5-9dee-5a93262fc656 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:32.054620 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-12e86839-e7a0-49f5-9dee-5a93262fc656 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.157226 Jun 16 14:57:32.054824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 130/269] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:31 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:32.457676 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-2bfef175-7d76-4619-9074-cf372a60c860 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:32.458281 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-2bfef175-7d76-4619-9074-cf372a60c860 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:32.464300 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2bfef175-7d76-4619-9074-cf372a60c860 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:32.464745 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2bfef175-7d76-4619-9074-cf372a60c860 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:32.465498 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2bfef175-7d76-4619-9074-cf372a60c860 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:32.465930 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2bfef175-7d76-4619-9074-cf372a60c860 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:32.470330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=100 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:32.599025 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2bfef175-7d76-4619-9074-cf372a60c860 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:32.606692 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-2bfef175-7d76-4619-9074-cf372a60c860 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1506 microversion: 2.1 time: 0.153149 Jun 16 14:57:32.607244 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 140/270] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:32 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:32.951442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-fd390bb2-dc49-4da7-bbe6-20a56b636384 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:32.952072 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-fd390bb2-dc49-4da7-bbe6-20a56b636384 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:32.960266 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fd390bb2-dc49-4da7-bbe6-20a56b636384 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:32.960784 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fd390bb2-dc49-4da7-bbe6-20a56b636384 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:32.961882 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fd390bb2-dc49-4da7-bbe6-20a56b636384 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:32.962390 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fd390bb2-dc49-4da7-bbe6-20a56b636384 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:33.072085 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b247b12b-c74e-40b0-b427-a447087c040c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:33.072956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b247b12b-c74e-40b0-b427-a447087c040c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:33.080798 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b247b12b-c74e-40b0-b427-a447087c040c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:33.081655 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b247b12b-c74e-40b0-b427-a447087c040c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:33.082956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b247b12b-c74e-40b0-b427-a447087c040c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:33.083809 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b247b12b-c74e-40b0-b427-a447087c040c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:33.109418 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fd390bb2-dc49-4da7-bbe6-20a56b636384 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:33.117723 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-fd390bb2-dc49-4da7-bbe6-20a56b636384 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1503 microversion: 2.1 time: 0.170063 Jun 16 14:57:33.118338 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 131/271] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:32 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:33.216224 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b247b12b-c74e-40b0-b427-a447087c040c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:33.224438 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b247b12b-c74e-40b0-b427-a447087c040c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.156464 Jun 16 14:57:33.224999 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 141/272] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:33 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:34.134641 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-251fb148-8124-4f22-bde7-db24ec2a660e tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:34.135245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-251fb148-8124-4f22-bde7-db24ec2a660e tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:34.141691 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-251fb148-8124-4f22-bde7-db24ec2a660e tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:34.142133 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-251fb148-8124-4f22-bde7-db24ec2a660e tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:34.142885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-251fb148-8124-4f22-bde7-db24ec2a660e tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:34.143316 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-251fb148-8124-4f22-bde7-db24ec2a660e tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:34.241271 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b47130e0-292b-4a69-9a3f-78e7a25daf96 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:34.242026 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b47130e0-292b-4a69-9a3f-78e7a25daf96 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:34.248156 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b47130e0-292b-4a69-9a3f-78e7a25daf96 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:34.248676 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b47130e0-292b-4a69-9a3f-78e7a25daf96 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:34.249520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b47130e0-292b-4a69-9a3f-78e7a25daf96 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:34.250788 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b47130e0-292b-4a69-9a3f-78e7a25daf96 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:34.281999 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-251fb148-8124-4f22-bde7-db24ec2a660e tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:34.289508 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-251fb148-8124-4f22-bde7-db24ec2a660e tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1503 microversion: 2.1 time: 0.158653 Jun 16 14:57:34.290077 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 132/273] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:34 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:34.385892 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b47130e0-292b-4a69-9a3f-78e7a25daf96 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:34.393885 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b47130e0-292b-4a69-9a3f-78e7a25daf96 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.156592 Jun 16 14:57:34.394442 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 142/274] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:34 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:35.307066 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4289cca7-112e-4a06-ac00-6ed794266c90 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:35.307705 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4289cca7-112e-4a06-ac00-6ed794266c90 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:35.310243 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:35.315946 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4289cca7-112e-4a06-ac00-6ed794266c90 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:35.316426 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4289cca7-112e-4a06-ac00-6ed794266c90 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:35.317195 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4289cca7-112e-4a06-ac00-6ed794266c90 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:35.317631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4289cca7-112e-4a06-ac00-6ed794266c90 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:35.410993 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-87efd037-9859-47ab-8fc1-14cb7e9af057 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:35.411605 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-87efd037-9859-47ab-8fc1-14cb7e9af057 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:35.418040 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-87efd037-9859-47ab-8fc1-14cb7e9af057 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:35.418491 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-87efd037-9859-47ab-8fc1-14cb7e9af057 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:35.419256 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-87efd037-9859-47ab-8fc1-14cb7e9af057 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:35.419697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-87efd037-9859-47ab-8fc1-14cb7e9af057 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:35.449050 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4289cca7-112e-4a06-ac00-6ed794266c90 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:35.456554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4289cca7-112e-4a06-ac00-6ed794266c90 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1503 microversion: 2.1 time: 0.153344 Jun 16 14:57:35.457114 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 133/275] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:35 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:35.555986 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-87efd037-9859-47ab-8fc1-14cb7e9af057 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:35.563791 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-87efd037-9859-47ab-8fc1-14cb7e9af057 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.156646 Jun 16 14:57:35.564351 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 143/276] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:35 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:36.474327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d5c665dc-4140-4b39-8647-e584261ca8da tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:36.475072 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d5c665dc-4140-4b39-8647-e584261ca8da tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:36.481605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d5c665dc-4140-4b39-8647-e584261ca8da tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:36.482059 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d5c665dc-4140-4b39-8647-e584261ca8da tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:36.482829 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d5c665dc-4140-4b39-8647-e584261ca8da tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:36.483269 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d5c665dc-4140-4b39-8647-e584261ca8da tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:36.583055 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-39703396-9990-413f-bb8a-47150df8dfd3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:36.584793 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-39703396-9990-413f-bb8a-47150df8dfd3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:36.591869 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-39703396-9990-413f-bb8a-47150df8dfd3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:36.592639 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-39703396-9990-413f-bb8a-47150df8dfd3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:36.593571 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-39703396-9990-413f-bb8a-47150df8dfd3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:36.594155 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-39703396-9990-413f-bb8a-47150df8dfd3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:36.725640 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d5c665dc-4140-4b39-8647-e584261ca8da tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:36.733121 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d5c665dc-4140-4b39-8647-e584261ca8da tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1503 microversion: 2.1 time: 0.263557 Jun 16 14:57:36.733829 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 134/277] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:36 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1503 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:36.830877 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-15396e69-8e68-46d2-ad7a-d13ebce028e1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:36.831747 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-15396e69-8e68-46d2-ad7a-d13ebce028e1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:36.841157 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-15396e69-8e68-46d2-ad7a-d13ebce028e1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:36.841753 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-15396e69-8e68-46d2-ad7a-d13ebce028e1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:36.842773 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-15396e69-8e68-46d2-ad7a-d13ebce028e1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:36.843986 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-15396e69-8e68-46d2-ad7a-d13ebce028e1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:36.853711 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-39703396-9990-413f-bb8a-47150df8dfd3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:36.865305 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-39703396-9990-413f-bb8a-47150df8dfd3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.288439 Jun 16 14:57:36.866066 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 144/278] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:36 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:36.869717 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-15396e69-8e68-46d2-ad7a-d13ebce028e1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/ips" status: 200 len: 149 microversion: 2.1 time: 0.042964 Jun 16 14:57:36.870365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 135/279] 10.222.0.76 () {58 vars in 1247 bytes} [Thu Jun 16 14:57:36 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:37.342672 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-df0a60f5-b2df-4f1e-ad09-9f8372502bcd req-2ad6bdbb-b268-45f8-b882-5a844e48552c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66e9804b-1fee-4e34-a1fc-0824fc3e69c8", "name": "network-vif-deleted", "tag": "918da2f2-f872-42f2-9d05-0edde2fec6b2"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:37.351107 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-df0a60f5-b2df-4f1e-ad09-9f8372502bcd req-2ad6bdbb-b268-45f8-b882-5a844e48552c service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:37.351556 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-df0a60f5-b2df-4f1e-ad09-9f8372502bcd req-2ad6bdbb-b268-45f8-b882-5a844e48552c service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:37.363226 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-df0a60f5-b2df-4f1e-ad09-9f8372502bcd req-2ad6bdbb-b268-45f8-b882-5a844e48552c service nova] Creating event network-vif-deleted:918da2f2-f872-42f2-9d05-0edde2fec6b2 for instance 66e9804b-1fee-4e34-a1fc-0824fc3e69c8 on hv-cinder-83716 Jun 16 14:57:37.368151 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-df0a60f5-b2df-4f1e-ad09-9f8372502bcd req-2ad6bdbb-b268-45f8-b882-5a844e48552c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030491 Jun 16 14:57:37.368733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 145/280] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:37.754794 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6b43a233-7fb2-4283-8533-b3399bdc56f2 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:37.755395 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6b43a233-7fb2-4283-8533-b3399bdc56f2 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:37.761878 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6b43a233-7fb2-4283-8533-b3399bdc56f2 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:37.762321 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6b43a233-7fb2-4283-8533-b3399bdc56f2 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:37.763073 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6b43a233-7fb2-4283-8533-b3399bdc56f2 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:37.763501 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6b43a233-7fb2-4283-8533-b3399bdc56f2 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:37.829425 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6b43a233-7fb2-4283-8533-b3399bdc56f2 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:37.837030 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6b43a233-7fb2-4283-8533-b3399bdc56f2 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1461 microversion: 2.1 time: 0.085991 Jun 16 14:57:37.837829 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 136/281] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:37 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1461 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:37.882263 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1766de77-4134-4f1c-93d0-e2dd52ea757a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:37.883008 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-1766de77-4134-4f1c-93d0-e2dd52ea757a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:37.889605 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1766de77-4134-4f1c-93d0-e2dd52ea757a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:37.890055 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1766de77-4134-4f1c-93d0-e2dd52ea757a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:37.891319 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1766de77-4134-4f1c-93d0-e2dd52ea757a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:37.891784 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1766de77-4134-4f1c-93d0-e2dd52ea757a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:38.040319 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1766de77-4134-4f1c-93d0-e2dd52ea757a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:38.050324 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1766de77-4134-4f1c-93d0-e2dd52ea757a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.172167 Jun 16 14:57:38.051166 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 146/282] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:37 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:38.406142 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e2827abe-5929-4a97-8681-1aca5e80e3ce tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17712aaf-f87a-4a4c-ae2c-ca14dfebbc25"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:38.407796 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e2827abe-5929-4a97-8681-1aca5e80e3ce tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:38.415522 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e2827abe-5929-4a97-8681-1aca5e80e3ce tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:38.415522 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e2827abe-5929-4a97-8681-1aca5e80e3ce tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:38.416418 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e2827abe-5929-4a97-8681-1aca5e80e3ce tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:38.417240 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e2827abe-5929-4a97-8681-1aca5e80e3ce tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:38.855711 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e2122a85-74db-4b9b-90c7-ed8170cf8aad tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:38.856343 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e2122a85-74db-4b9b-90c7-ed8170cf8aad tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:38.862594 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e2122a85-74db-4b9b-90c7-ed8170cf8aad tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:38.863038 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e2122a85-74db-4b9b-90c7-ed8170cf8aad tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:38.863914 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e2122a85-74db-4b9b-90c7-ed8170cf8aad tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:38.864354 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e2122a85-74db-4b9b-90c7-ed8170cf8aad tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:38.897562 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e2122a85-74db-4b9b-90c7-ed8170cf8aad tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:38.898181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e2122a85-74db-4b9b-90c7-ed8170cf8aad tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:38.898454 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.objects.instance [None req-e2122a85-74db-4b9b-90c7-ed8170cf8aad tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lazy-loading 'fault' on Instance uuid 66e9804b-1fee-4e34-a1fc-0824fc3e69c8 {{(pid=117443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:57:38.946324 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e2122a85-74db-4b9b-90c7-ed8170cf8aad tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:38.954869 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e2122a85-74db-4b9b-90c7-ed8170cf8aad tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 200 len: 1303 microversion: 2.1 time: 0.102882 Jun 16 14:57:38.955436 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 147/283] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:38 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:39.075837 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7cbdcccd-3dc4-4fd7-b69d-346a42f1a1dc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:39.077183 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7cbdcccd-3dc4-4fd7-b69d-346a42f1a1dc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:39.097913 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7cbdcccd-3dc4-4fd7-b69d-346a42f1a1dc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:39.098720 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7cbdcccd-3dc4-4fd7-b69d-346a42f1a1dc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:39.099807 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7cbdcccd-3dc4-4fd7-b69d-346a42f1a1dc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:39.100520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7cbdcccd-3dc4-4fd7-b69d-346a42f1a1dc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:39.292211 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e2827abe-5929-4a97-8681-1aca5e80e3ce tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "POST /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.890248 Jun 16 14:57:39.301570 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 137/284] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Jun 16 14:57:38 2022] POST /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments => generated 194 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:39.328055 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7cbdcccd-3dc4-4fd7-b69d-346a42f1a1dc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:39.342667 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7cbdcccd-3dc4-4fd7-b69d-346a42f1a1dc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.271012 Jun 16 14:57:39.343320 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 148/285] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:39 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:39.973863 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-abbda49e-49a3-4531-b95d-eac948266f36 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:39.974623 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-abbda49e-49a3-4531-b95d-eac948266f36 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 66e9804b-1fee-4e34-a1fc-0824fc3e69c8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:39.981047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-abbda49e-49a3-4531-b95d-eac948266f36 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:39.981501 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-abbda49e-49a3-4531-b95d-eac948266f36 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:39.982275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-abbda49e-49a3-4531-b95d-eac948266f36 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:39.982719 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-abbda49e-49a3-4531-b95d-eac948266f36 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:39.997564 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-abbda49e-49a3-4531-b95d-eac948266f36 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] HTTP exception thrown: Instance 66e9804b-1fee-4e34-a1fc-0824fc3e69c8 could not be found. Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-abbda49e-49a3-4531-b95d-eac948266f36 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Request method failure captured: Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 HTTP/1.1 Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0TFa1JfrDdMnRhgxvF5a4RqO5OPtEatOh5aymp7U3s7xCepC7-nOwbA29iqR7eoyoKQiF6fWo_2lisBb6J2y99SKlzkSyHiIBse1XaEEDDzITtFuhEW2Ay_DhGko8F2i8sh7busn_KxtVu1nvlxdpTpGHkkxEpN2frcqc4ZgG9lEBQ Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 8e9e827220104db5a73cf01d58418648 Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-VolumesActionsTest-1632504662 Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 14:57:39.999224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 14:57:40.000605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8e9e827220104db5a73cf01d58418648"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8e9e827220104db5a73cf01d58418648"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8e9e827220104db5a73cf01d58418648"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8e9e827220104db5a73cf01d58418648"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:57:40.000605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-VolumesActionsTest-1632504662 Jun 16 14:57:40.000605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 8e9e827220104db5a73cf01d58418648 Jun 16 14:57:40.000605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-VolumesActionsTest-1632504662 Jun 16 14:57:40.000605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-VolumesActionsTest-1632504662-project Jun 16 14:57:40.000605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 14:57:40.000605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 14:57:40.000605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: d6824c7c97414a72bec98f8c819356ff Jun 16 14:57:40.000605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-VolumesActionsTest-1632504662-project Jun 16 14:57:40.000605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 14:57:40.000605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance 66e9804b-1fee-4e34-a1fc-0824fc3e69c8 could not be found. Jun 16 14:57:40.000605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': '66e9804b-1fee-4e34-a1fc-0824fc3e69c8'} Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66e9804b-1fee-4e34-a1fc-0824fc3e69c8 could not be found. Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:57:40.001337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:57:40.002630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:57:40.002630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:57:40.002630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:57:40.002630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:57:40.002630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:57:40.002630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:57:40.002630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:57:40.002630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66e9804b-1fee-4e34-a1fc-0824fc3e69c8 could not be found. Jun 16 14:57:40.002630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:57:40.002630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:40.002630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:57:40.002630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:40.002630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:40.002630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:40.002630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:57:40.002630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:57:40.002630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66e9804b-1fee-4e34-a1fc-0824fc3e69c8 could not be found. Jun 16 14:57:40.002630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:57:40.004496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-abbda49e-49a3-4531-b95d-eac948266f36 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Returning 404 to user: Instance 66e9804b-1fee-4e34-a1fc-0824fc3e69c8 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:57:40.004496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-abbda49e-49a3-4531-b95d-eac948266f36 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8" status: 404 len: 111 microversion: 2.1 time: 0.032381 Jun 16 14:57:40.004496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 138/286] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:39 2022] GET /compute/v2.1/servers/66e9804b-1fee-4e34-a1fc-0824fc3e69c8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:57:40.126018 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-dee7cee0-e892-4e45-a14f-79e010bc260d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1873457929", "imageRef": "f2f37ffa-db20-478d-84c0-b429a987933c", "flavorRef": "452", "networks": [{"uuid": "5b7fed89-cfd8-4506-aae7-73bc629e09da"}]}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:40.181476 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.network.neutron [None req-dee7cee0-e892-4e45-a14f-79e010bc260d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] validate_networks() for [('5b7fed89-cfd8-4506-aae7-73bc629e09da', None, None, None, None, None)] {{(pid=117443) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:57:40.360867 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-de4f0401-aaf2-4dbf-a678-9158490bd61a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:40.361795 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-de4f0401-aaf2-4dbf-a678-9158490bd61a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:40.370445 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-de4f0401-aaf2-4dbf-a678-9158490bd61a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:40.371928 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-de4f0401-aaf2-4dbf-a678-9158490bd61a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:40.372731 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-de4f0401-aaf2-4dbf-a678-9158490bd61a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:40.374864 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-de4f0401-aaf2-4dbf-a678-9158490bd61a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:40.872742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-de4f0401-aaf2-4dbf-a678-9158490bd61a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:40.879536 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:40.888319 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-de4f0401-aaf2-4dbf-a678-9158490bd61a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1521 microversion: 2.1 time: 0.531317 Jun 16 14:57:40.889492 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 139/287] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:40 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:41.009739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-dee7cee0-e892-4e45-a14f-79e010bc260d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Flavor limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:57:41.010169 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-dee7cee0-e892-4e45-a14f-79e010bc260d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Image limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:57:41.010832 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-dee7cee0-e892-4e45-a14f-79e010bc260d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Flavor pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:57:41.011247 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-dee7cee0-e892-4e45-a14f-79e010bc260d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Image pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:57:41.011775 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-dee7cee0-e892-4e45-a14f-79e010bc260d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:57:41.021949 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dee7cee0-e892-4e45-a14f-79e010bc260d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:41.022399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dee7cee0-e892-4e45-a14f-79e010bc260d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:41.023218 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dee7cee0-e892-4e45-a14f-79e010bc260d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:41.023655 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dee7cee0-e892-4e45-a14f-79e010bc260d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:41.043705 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-dee7cee0-e892-4e45-a14f-79e010bc260d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Getting quotas for project 8e9e827220104db5a73cf01d58418648. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:57:41.048529 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-dee7cee0-e892-4e45-a14f-79e010bc260d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Getting quotas for user d6824c7c97414a72bec98f8c819356ff and project 8e9e827220104db5a73cf01d58418648. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:57:41.060770 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-dee7cee0-e892-4e45-a14f-79e010bc260d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Going to run 1 instances... {{(pid=117443) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:57:41.063301 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-dee7cee0-e892-4e45-a14f-79e010bc260d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2f37ffa-db20-478d-84c0-b429a987933c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:57:41.116382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-dee7cee0-e892-4e45-a14f-79e010bc260d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.993939 Jun 16 14:57:41.117193 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 149/288] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 14:57:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:57:41.131140 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-beabfe37-d71e-4859-9889-b1be857995c2 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:41.131941 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-beabfe37-d71e-4859-9889-b1be857995c2 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:41.209830 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-beabfe37-d71e-4859-9889-b1be857995c2 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:41.217074 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-beabfe37-d71e-4859-9889-b1be857995c2 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1214 microversion: 2.1 time: 0.093312 Jun 16 14:57:41.217947 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 140/289] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:41 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:41.908602 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-58b7f938-de93-4599-81ac-4e76ca1e179d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:41.909480 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-58b7f938-de93-4599-81ac-4e76ca1e179d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:41.917119 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-58b7f938-de93-4599-81ac-4e76ca1e179d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:41.917485 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-58b7f938-de93-4599-81ac-4e76ca1e179d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:41.918551 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-58b7f938-de93-4599-81ac-4e76ca1e179d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:41.918987 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-58b7f938-de93-4599-81ac-4e76ca1e179d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:42.100213 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-58b7f938-de93-4599-81ac-4e76ca1e179d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:42.109876 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-58b7f938-de93-4599-81ac-4e76ca1e179d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1501 microversion: 2.1 time: 0.205540 Jun 16 14:57:42.110388 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 150/290] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:41 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1501 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:42.130385 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7e3f7295-7f99-4973-bcc0-1e0c6e673107 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:42.131115 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7e3f7295-7f99-4973-bcc0-1e0c6e673107 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:42.137912 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e3f7295-7f99-4973-bcc0-1e0c6e673107 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:42.138609 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e3f7295-7f99-4973-bcc0-1e0c6e673107 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:42.139409 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e3f7295-7f99-4973-bcc0-1e0c6e673107 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:42.139876 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e3f7295-7f99-4973-bcc0-1e0c6e673107 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:42.238555 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-34f9fe1a-9e3a-40bb-90a7-a3f7dbd5ad98 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:42.239915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-34f9fe1a-9e3a-40bb-90a7-a3f7dbd5ad98 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:42.248898 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-34f9fe1a-9e3a-40bb-90a7-a3f7dbd5ad98 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:42.249353 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-34f9fe1a-9e3a-40bb-90a7-a3f7dbd5ad98 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:42.250155 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-34f9fe1a-9e3a-40bb-90a7-a3f7dbd5ad98 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:42.250614 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-34f9fe1a-9e3a-40bb-90a7-a3f7dbd5ad98 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:42.291942 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7e3f7295-7f99-4973-bcc0-1e0c6e673107 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:42.300347 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7e3f7295-7f99-4973-bcc0-1e0c6e673107 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1516 microversion: 2.1 time: 0.174475 Jun 16 14:57:42.301100 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 141/291] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:42 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:42.331528 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-34f9fe1a-9e3a-40bb-90a7-a3f7dbd5ad98 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:42.340935 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-34f9fe1a-9e3a-40bb-90a7-a3f7dbd5ad98 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1218 microversion: 2.1 time: 0.107811 Jun 16 14:57:42.341604 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 151/292] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:42 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:43.363200 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0580c38f-dba0-4a29-8578-9cababd5f99a tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:43.364036 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0580c38f-dba0-4a29-8578-9cababd5f99a tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:43.371324 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0580c38f-dba0-4a29-8578-9cababd5f99a tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:43.372111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0580c38f-dba0-4a29-8578-9cababd5f99a tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:43.373510 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0580c38f-dba0-4a29-8578-9cababd5f99a tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:43.373967 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0580c38f-dba0-4a29-8578-9cababd5f99a tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:43.447897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0580c38f-dba0-4a29-8578-9cababd5f99a tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:43.456147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0580c38f-dba0-4a29-8578-9cababd5f99a tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1218 microversion: 2.1 time: 0.097957 Jun 16 14:57:43.456708 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 142/293] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:43 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:44.473629 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b9b5ccd7-0752-4d7e-b4d6-0749f9fe9a5c tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:44.474247 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b9b5ccd7-0752-4d7e-b4d6-0749f9fe9a5c tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:44.484777 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b9b5ccd7-0752-4d7e-b4d6-0749f9fe9a5c tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:44.485267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b9b5ccd7-0752-4d7e-b4d6-0749f9fe9a5c tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:44.486393 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b9b5ccd7-0752-4d7e-b4d6-0749f9fe9a5c tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:44.487013 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b9b5ccd7-0752-4d7e-b4d6-0749f9fe9a5c tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:44.562287 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b9b5ccd7-0752-4d7e-b4d6-0749f9fe9a5c tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:44.570657 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b9b5ccd7-0752-4d7e-b4d6-0749f9fe9a5c tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1210 microversion: 2.1 time: 0.100825 Jun 16 14:57:44.571235 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 152/294] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:44 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:44.926026 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f7b280a7-1ff9-4422-914f-7ada1de27769 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:44.927775 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f7b280a7-1ff9-4422-914f-7ada1de27769 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:44.940949 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f7b280a7-1ff9-4422-914f-7ada1de27769 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:44.941519 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f7b280a7-1ff9-4422-914f-7ada1de27769 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:44.942431 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f7b280a7-1ff9-4422-914f-7ada1de27769 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:44.942939 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f7b280a7-1ff9-4422-914f-7ada1de27769 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:44.970194 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-f7b280a7-1ff9-4422-914f-7ada1de27769 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lazy-loading 'flavor' on Instance uuid 7d2fec0d-b149-4a09-8708-1654b2d88ac0 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:57:45.065852 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f7b280a7-1ff9-4422-914f-7ada1de27769 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "POST /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0/action" status: 200 len: 32 microversion: 2.1 time: 0.148407 Jun 16 14:57:45.067145 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 143/295] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Jun 16 14:57:44 2022] POST /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0/action => generated 32 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:57:45.084560 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6be65aa0-3ff4-4ecf-9b3c-ff30c57cc711 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:45.086115 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6be65aa0-3ff4-4ecf-9b3c-ff30c57cc711 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:45.097027 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6be65aa0-3ff4-4ecf-9b3c-ff30c57cc711 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:45.097784 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6be65aa0-3ff4-4ecf-9b3c-ff30c57cc711 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:45.099081 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6be65aa0-3ff4-4ecf-9b3c-ff30c57cc711 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:45.099851 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6be65aa0-3ff4-4ecf-9b3c-ff30c57cc711 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:45.315061 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6be65aa0-3ff4-4ecf-9b3c-ff30c57cc711 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:45.329542 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6be65aa0-3ff4-4ecf-9b3c-ff30c57cc711 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.254752 Jun 16 14:57:45.330559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 153/296] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:45 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:45.589621 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-325481fa-e8d9-420e-9d34-dc3a8e7cfc23 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:45.590535 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-325481fa-e8d9-420e-9d34-dc3a8e7cfc23 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:45.599037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-325481fa-e8d9-420e-9d34-dc3a8e7cfc23 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:45.599670 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-325481fa-e8d9-420e-9d34-dc3a8e7cfc23 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:45.600582 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-325481fa-e8d9-420e-9d34-dc3a8e7cfc23 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:45.601139 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-325481fa-e8d9-420e-9d34-dc3a8e7cfc23 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:45.702798 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-325481fa-e8d9-420e-9d34-dc3a8e7cfc23 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:45.711901 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-325481fa-e8d9-420e-9d34-dc3a8e7cfc23 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1284 microversion: 2.1 time: 0.126709 Jun 16 14:57:45.718168 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 144/297] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:45 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:46.347540 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7225d465-a81b-4c53-822e-266d6427dca2 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:46.348249 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7225d465-a81b-4c53-822e-266d6427dca2 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:46.361538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7225d465-a81b-4c53-822e-266d6427dca2 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:46.362441 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7225d465-a81b-4c53-822e-266d6427dca2 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:46.363546 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7225d465-a81b-4c53-822e-266d6427dca2 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:46.364866 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7225d465-a81b-4c53-822e-266d6427dca2 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:46.730161 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-537203f8-1501-4018-aea1-32b793319962 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:46.730780 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-537203f8-1501-4018-aea1-32b793319962 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:46.738338 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-537203f8-1501-4018-aea1-32b793319962 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:46.738816 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-537203f8-1501-4018-aea1-32b793319962 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:46.739904 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-537203f8-1501-4018-aea1-32b793319962 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:46.740992 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-537203f8-1501-4018-aea1-32b793319962 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:46.910295 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-537203f8-1501-4018-aea1-32b793319962 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:46.919626 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-537203f8-1501-4018-aea1-32b793319962 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1272 microversion: 2.1 time: 0.192507 Jun 16 14:57:46.930698 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 145/298] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:46 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:46.935666 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7225d465-a81b-4c53-822e-266d6427dca2 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:46.944611 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7225d465-a81b-4c53-822e-266d6427dca2 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.601845 Jun 16 14:57:46.945597 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 154/299] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:46 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:47.938935 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-03912583-6f79-4c76-b9ac-f661c195f4ed tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:47.940014 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-03912583-6f79-4c76-b9ac-f661c195f4ed tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:47.954005 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-03912583-6f79-4c76-b9ac-f661c195f4ed tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:47.954903 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-03912583-6f79-4c76-b9ac-f661c195f4ed tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:47.956019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-03912583-6f79-4c76-b9ac-f661c195f4ed tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:47.956537 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-03912583-6f79-4c76-b9ac-f661c195f4ed tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:47.962657 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3ea5ad96-5473-419d-aa74-bad1afb81a82 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:47.963308 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-3ea5ad96-5473-419d-aa74-bad1afb81a82 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:47.966842 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:47.985970 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3ea5ad96-5473-419d-aa74-bad1afb81a82 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:47.986432 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3ea5ad96-5473-419d-aa74-bad1afb81a82 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:47.987231 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3ea5ad96-5473-419d-aa74-bad1afb81a82 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:47.987662 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3ea5ad96-5473-419d-aa74-bad1afb81a82 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:48.379190 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3ea5ad96-5473-419d-aa74-bad1afb81a82 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:48.388023 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3ea5ad96-5473-419d-aa74-bad1afb81a82 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.429489 Jun 16 14:57:48.388631 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 155/300] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:47 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:48.394805 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-03912583-6f79-4c76-b9ac-f661c195f4ed tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:48.402758 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-03912583-6f79-4c76-b9ac-f661c195f4ed tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1314 microversion: 2.1 time: 0.468235 Jun 16 14:57:48.413778 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 146/301] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:47 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:48.415222 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-461a9c70-b577-44fd-90cd-de5cebd324d2 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Action: 'create', calling method: .version_select at 0x7f33e16bd940>, body: {"keypair": {"name": "tempest-keypair-1680252146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcZF5BsLuKr5Rc9nALuHx442aMomzZPOmtNMPCtwWJnYn3eMw5vvUBuu+qdnaHL8N/cIZ6/bObWv/b5BQISaSa6wnx64btCxwO8NArksMnaUU6cgO3A6OPnog4ZTnOkPA=="}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:48.431932 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-461a9c70-b577-44fd-90cd-de5cebd324d2 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Getting quotas for project 60ade68614ac4730a35c9958123d06e8. Resources: {'key_pairs'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:57:48.436695 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-461a9c70-b577-44fd-90cd-de5cebd324d2 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Getting quotas for user 87a6ec62b5414930bf36f69f072d7df6 and project 60ade68614ac4730a35c9958123d06e8. Resources: {'key_pairs'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:57:48.466618 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-461a9c70-b577-44fd-90cd-de5cebd324d2 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056634 Jun 16 14:57:48.472164 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 156/302] 10.222.0.76 () {60 vars in 1158 bytes} [Thu Jun 16 14:57:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:49.221301 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-1247b612-f7dc-4ea3-a447-5cddf00b3592 req-c2828050-e582-40a9-9ce9-b6febe4a51b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "000799b2-d8b1-4e97-8de4-9a6f42cd0596", "tag": "8c617ea8-e144-480c-8ec3-878436728ec7"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:49.241389 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-1247b612-f7dc-4ea3-a447-5cddf00b3592 req-c2828050-e582-40a9-9ce9-b6febe4a51b9 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:49.243282 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-1247b612-f7dc-4ea3-a447-5cddf00b3592 req-c2828050-e582-40a9-9ce9-b6febe4a51b9 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:49.283311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-1247b612-f7dc-4ea3-a447-5cddf00b3592 req-c2828050-e582-40a9-9ce9-b6febe4a51b9 service nova] Creating event network-changed:8c617ea8-e144-480c-8ec3-878436728ec7 for instance 000799b2-d8b1-4e97-8de4-9a6f42cd0596 on hv-cinder-83716 Jun 16 14:57:49.290424 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-1247b612-f7dc-4ea3-a447-5cddf00b3592 req-c2828050-e582-40a9-9ce9-b6febe4a51b9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073111 Jun 16 14:57:49.290916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 147/303] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:49.408701 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c52a0822-b694-487e-8c3c-b1d494d37d98 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:49.409332 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c52a0822-b694-487e-8c3c-b1d494d37d98 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:49.424637 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c52a0822-b694-487e-8c3c-b1d494d37d98 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:49.432166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3e8af37d-fe70-4ab8-bfb0-23b9aebab5c3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:49.433040 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c52a0822-b694-487e-8c3c-b1d494d37d98 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:49.433886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c52a0822-b694-487e-8c3c-b1d494d37d98 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:49.434317 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c52a0822-b694-487e-8c3c-b1d494d37d98 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:49.440829 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3e8af37d-fe70-4ab8-bfb0-23b9aebab5c3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:49.469267 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e8af37d-fe70-4ab8-bfb0-23b9aebab5c3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:49.472052 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e8af37d-fe70-4ab8-bfb0-23b9aebab5c3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:49.476076 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e8af37d-fe70-4ab8-bfb0-23b9aebab5c3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:49.476720 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e8af37d-fe70-4ab8-bfb0-23b9aebab5c3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:49.979226 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c52a0822-b694-487e-8c3c-b1d494d37d98 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:49.995647 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c52a0822-b694-487e-8c3c-b1d494d37d98 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.592253 Jun 16 14:57:50.001621 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 157/304] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:49 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:50.010710 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3e8af37d-fe70-4ab8-bfb0-23b9aebab5c3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:50.025453 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3e8af37d-fe70-4ab8-bfb0-23b9aebab5c3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1314 microversion: 2.1 time: 0.607872 Jun 16 14:57:50.026480 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 148/305] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:49 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:51.024612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b0bff5ec-11d3-4b59-a8ce-c190584bb5fb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:51.025518 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b0bff5ec-11d3-4b59-a8ce-c190584bb5fb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:51.035127 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=2 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:51.038124 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b0bff5ec-11d3-4b59-a8ce-c190584bb5fb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:51.038876 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b0bff5ec-11d3-4b59-a8ce-c190584bb5fb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:51.040152 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b0bff5ec-11d3-4b59-a8ce-c190584bb5fb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:51.040824 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b0bff5ec-11d3-4b59-a8ce-c190584bb5fb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:51.043121 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6733276d-223f-4780-9e7c-dbd54c08e011 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:51.043839 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6733276d-223f-4780-9e7c-dbd54c08e011 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:51.052592 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6733276d-223f-4780-9e7c-dbd54c08e011 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:51.053035 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6733276d-223f-4780-9e7c-dbd54c08e011 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:51.053818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6733276d-223f-4780-9e7c-dbd54c08e011 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:51.057536 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6733276d-223f-4780-9e7c-dbd54c08e011 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:51.214057 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:51.425216 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b0bff5ec-11d3-4b59-a8ce-c190584bb5fb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:51.428949 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=100 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:51.435405 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b0bff5ec-11d3-4b59-a8ce-c190584bb5fb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.416778 Jun 16 14:57:51.436162 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 158/306] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:51 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:51.446096 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6733276d-223f-4780-9e7c-dbd54c08e011 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:51.456244 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6733276d-223f-4780-9e7c-dbd54c08e011 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1314 microversion: 2.1 time: 0.416258 Jun 16 14:57:51.467011 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 149/307] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:51 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:52.401085 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e7f585e0-bae0-4ed3-9500-e1fdde40c4c9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2144444147", "imageRef": "f2f37ffa-db20-478d-84c0-b429a987933c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3e2520f-526d-4c84-9c0f-99f9be8b2582"}], "security_groups": [{"name": "tempest-securitygroup--282170249"}], "key_name": "tempest-keypair-1680252146", "user_data": "}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:52.456110 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ebab8f6c-1911-4747-aa59-02631a96d1f2 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:52.458113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ebab8f6c-1911-4747-aa59-02631a96d1f2 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:52.482368 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ebab8f6c-1911-4747-aa59-02631a96d1f2 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:52.483300 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ebab8f6c-1911-4747-aa59-02631a96d1f2 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:52.486053 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ebab8f6c-1911-4747-aa59-02631a96d1f2 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:52.486817 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ebab8f6c-1911-4747-aa59-02631a96d1f2 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:52.594132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.network.neutron [None req-e7f585e0-bae0-4ed3-9500-e1fdde40c4c9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] validate_networks() for [('f3e2520f-526d-4c84-9c0f-99f9be8b2582', None, None, None, None, None)] {{(pid=117443) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:57:52.763373 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ebab8f6c-1911-4747-aa59-02631a96d1f2 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:52.780616 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ebab8f6c-1911-4747-aa59-02631a96d1f2 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.330637 Jun 16 14:57:52.783315 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 150/308] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:52 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:52.790171 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2fe4cf29-eafe-4bd6-8a1b-47fdff6acb76 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:52.791239 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2fe4cf29-eafe-4bd6-8a1b-47fdff6acb76 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:52.804293 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2fe4cf29-eafe-4bd6-8a1b-47fdff6acb76 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:52.805124 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2fe4cf29-eafe-4bd6-8a1b-47fdff6acb76 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:52.807668 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2fe4cf29-eafe-4bd6-8a1b-47fdff6acb76 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:52.808755 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2fe4cf29-eafe-4bd6-8a1b-47fdff6acb76 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:53.060674 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2fe4cf29-eafe-4bd6-8a1b-47fdff6acb76 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:53.072992 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2fe4cf29-eafe-4bd6-8a1b-47fdff6acb76 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1314 microversion: 2.1 time: 0.288136 Jun 16 14:57:53.083130 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 151/309] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:52 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:53.447161 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-e7f585e0-bae0-4ed3-9500-e1fdde40c4c9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Flavor limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:57:53.448353 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-e7f585e0-bae0-4ed3-9500-e1fdde40c4c9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Image limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:57:53.449045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-e7f585e0-bae0-4ed3-9500-e1fdde40c4c9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Flavor pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:57:53.449601 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-e7f585e0-bae0-4ed3-9500-e1fdde40c4c9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Image pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:57:53.450202 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-e7f585e0-bae0-4ed3-9500-e1fdde40c4c9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:57:53.462579 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e7f585e0-bae0-4ed3-9500-e1fdde40c4c9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:53.463432 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e7f585e0-bae0-4ed3-9500-e1fdde40c4c9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:53.464516 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e7f585e0-bae0-4ed3-9500-e1fdde40c4c9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:53.465112 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e7f585e0-bae0-4ed3-9500-e1fdde40c4c9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:53.491569 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-e7f585e0-bae0-4ed3-9500-e1fdde40c4c9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Getting quotas for project 60ade68614ac4730a35c9958123d06e8. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:57:53.496776 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-e7f585e0-bae0-4ed3-9500-e1fdde40c4c9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Getting quotas for user 87a6ec62b5414930bf36f69f072d7df6 and project 60ade68614ac4730a35c9958123d06e8. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:57:53.510797 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e7f585e0-bae0-4ed3-9500-e1fdde40c4c9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Going to run 1 instances... {{(pid=117443) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:57:53.513261 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e7f585e0-bae0-4ed3-9500-e1fdde40c4c9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2f37ffa-db20-478d-84c0-b429a987933c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:57:53.589102 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e7f585e0-bae0-4ed3-9500-e1fdde40c4c9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.191967 Jun 16 14:57:53.597984 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 159/310] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 14:57:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 14:57:53.602434 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7c68726e-b37c-40a5-8e9d-66e70859e960 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:53.603199 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7c68726e-b37c-40a5-8e9d-66e70859e960 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:53.689763 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7c68726e-b37c-40a5-8e9d-66e70859e960 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:53.700605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7c68726e-b37c-40a5-8e9d-66e70859e960 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1242 microversion: 2.1 time: 0.101894 Jun 16 14:57:53.701456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 152/311] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:53 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:53.800381 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-07166293-b36a-457f-a4bf-66b49819081a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:53.801869 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-07166293-b36a-457f-a4bf-66b49819081a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:53.810291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-07166293-b36a-457f-a4bf-66b49819081a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:53.811065 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-07166293-b36a-457f-a4bf-66b49819081a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:53.812795 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-07166293-b36a-457f-a4bf-66b49819081a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:53.813586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-07166293-b36a-457f-a4bf-66b49819081a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:54.090494 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f882b395-c720-4347-9496-9eed005c4cf3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:54.092718 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f882b395-c720-4347-9496-9eed005c4cf3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:54.104420 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f882b395-c720-4347-9496-9eed005c4cf3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:54.105147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f882b395-c720-4347-9496-9eed005c4cf3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:54.106105 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f882b395-c720-4347-9496-9eed005c4cf3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:54.106697 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f882b395-c720-4347-9496-9eed005c4cf3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:54.164782 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-07166293-b36a-457f-a4bf-66b49819081a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:54.189090 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-07166293-b36a-457f-a4bf-66b49819081a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.393220 Jun 16 14:57:54.190145 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 160/312] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:53 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:54.300277 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f882b395-c720-4347-9496-9eed005c4cf3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:54.310256 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f882b395-c720-4347-9496-9eed005c4cf3 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1314 microversion: 2.1 time: 0.223560 Jun 16 14:57:54.311188 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 153/313] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:54 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:54.720374 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-83d68e90-eac3-4ce8-8d4e-5952706948e9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:54.720981 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-83d68e90-eac3-4ce8-8d4e-5952706948e9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:54.728152 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-83d68e90-eac3-4ce8-8d4e-5952706948e9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:54.728600 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-83d68e90-eac3-4ce8-8d4e-5952706948e9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:54.729373 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-83d68e90-eac3-4ce8-8d4e-5952706948e9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:54.729806 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-83d68e90-eac3-4ce8-8d4e-5952706948e9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:54.846995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-83d68e90-eac3-4ce8-8d4e-5952706948e9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:54.866356 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-83d68e90-eac3-4ce8-8d4e-5952706948e9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1238 microversion: 2.1 time: 0.150496 Jun 16 14:57:54.867745 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 161/314] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:54 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1238 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:55.210599 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-bf366084-d0f6-4577-b5d4-04c74cbcc151 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:55.211221 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-bf366084-d0f6-4577-b5d4-04c74cbcc151 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:55.241301 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bf366084-d0f6-4577-b5d4-04c74cbcc151 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:55.241974 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bf366084-d0f6-4577-b5d4-04c74cbcc151 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:55.242912 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bf366084-d0f6-4577-b5d4-04c74cbcc151 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:55.243760 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bf366084-d0f6-4577-b5d4-04c74cbcc151 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:55.332550 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-aaa1dd4f-ad32-4a23-8b81-b14a4901113d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:55.333298 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-aaa1dd4f-ad32-4a23-8b81-b14a4901113d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:55.345287 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aaa1dd4f-ad32-4a23-8b81-b14a4901113d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:55.348334 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aaa1dd4f-ad32-4a23-8b81-b14a4901113d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:55.349860 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aaa1dd4f-ad32-4a23-8b81-b14a4901113d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:55.350834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aaa1dd4f-ad32-4a23-8b81-b14a4901113d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:55.659437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-bf366084-d0f6-4577-b5d4-04c74cbcc151 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:55.686140 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-bf366084-d0f6-4577-b5d4-04c74cbcc151 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.479566 Jun 16 14:57:55.687006 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 154/315] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:55 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:55.700929 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-aaa1dd4f-ad32-4a23-8b81-b14a4901113d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:55.709938 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-aaa1dd4f-ad32-4a23-8b81-b14a4901113d tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1314 microversion: 2.1 time: 0.381534 Jun 16 14:57:55.710780 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 162/316] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:55 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:55.887013 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b80eb4d4-063d-42b9-a237-bf8222b65ab3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:55.888733 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b80eb4d4-063d-42b9-a237-bf8222b65ab3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:55.897719 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b80eb4d4-063d-42b9-a237-bf8222b65ab3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:55.898558 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b80eb4d4-063d-42b9-a237-bf8222b65ab3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:55.899885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b80eb4d4-063d-42b9-a237-bf8222b65ab3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:55.900529 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b80eb4d4-063d-42b9-a237-bf8222b65ab3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:56.017330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d62404d4-e231-4d85-93f6-78e7c8f10639 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:56.020284 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d62404d4-e231-4d85-93f6-78e7c8f10639 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:56.031473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d62404d4-e231-4d85-93f6-78e7c8f10639 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:56.033164 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d62404d4-e231-4d85-93f6-78e7c8f10639 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:56.038058 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d62404d4-e231-4d85-93f6-78e7c8f10639 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:56.038826 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d62404d4-e231-4d85-93f6-78e7c8f10639 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:56.071974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d62404d4-e231-4d85-93f6-78e7c8f10639 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/ips" status: 200 len: 152 microversion: 2.20 time: 0.069225 Jun 16 14:57:56.075118 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 163/317] 10.222.0.76 () {60 vars in 1288 bytes} [Thu Jun 16 14:57:56 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/ips => generated 152 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:57:56.306169 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-f64bd66f-d56f-4357-b86d-09b344dc9d57 req-eb25a66c-143b-40f7-bbb6-e49cc096f017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "000799b2-d8b1-4e97-8de4-9a6f42cd0596", "name": "network-vif-plugged", "status": "completed", "tag": "8c617ea8-e144-480c-8ec3-878436728ec7"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:56.335031 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-f64bd66f-d56f-4357-b86d-09b344dc9d57 req-eb25a66c-143b-40f7-bbb6-e49cc096f017 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:56.353879 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-f64bd66f-d56f-4357-b86d-09b344dc9d57 req-eb25a66c-143b-40f7-bbb6-e49cc096f017 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:56.396313 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-f64bd66f-d56f-4357-b86d-09b344dc9d57 req-eb25a66c-143b-40f7-bbb6-e49cc096f017 service nova] Creating event network-vif-plugged:8c617ea8-e144-480c-8ec3-878436728ec7 for instance 000799b2-d8b1-4e97-8de4-9a6f42cd0596 on hv-cinder-83716 Jun 16 14:57:56.410424 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-f64bd66f-d56f-4357-b86d-09b344dc9d57 req-eb25a66c-143b-40f7-bbb6-e49cc096f017 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107953 Jun 16 14:57:56.415270 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 164/318] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:57:56.456948 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b80eb4d4-063d-42b9-a237-bf8222b65ab3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:56.468841 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b80eb4d4-063d-42b9-a237-bf8222b65ab3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1300 microversion: 2.1 time: 0.587280 Jun 16 14:57:56.475162 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 155/319] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:55 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1300 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:56.709411 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-36a50afc-e5d7-496e-91fa-2fd273346afc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:56.710592 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-36a50afc-e5d7-496e-91fa-2fd273346afc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:56.728120 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-282b2927-ea04-47ad-b11f-a13a5e3a2dac tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:56.728909 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-282b2927-ea04-47ad-b11f-a13a5e3a2dac tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:56.741400 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-282b2927-ea04-47ad-b11f-a13a5e3a2dac tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:56.745222 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-282b2927-ea04-47ad-b11f-a13a5e3a2dac tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:56.750096 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-282b2927-ea04-47ad-b11f-a13a5e3a2dac tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:56.752581 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-282b2927-ea04-47ad-b11f-a13a5e3a2dac tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:56.755723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-36a50afc-e5d7-496e-91fa-2fd273346afc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:56.756374 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-36a50afc-e5d7-496e-91fa-2fd273346afc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:56.763104 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-36a50afc-e5d7-496e-91fa-2fd273346afc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:56.770905 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-36a50afc-e5d7-496e-91fa-2fd273346afc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:57.431357 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-36a50afc-e5d7-496e-91fa-2fd273346afc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:57.444553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-36a50afc-e5d7-496e-91fa-2fd273346afc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.742482 Jun 16 14:57:57.445136 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 165/320] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:56 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:57.465399 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-282b2927-ea04-47ad-b11f-a13a5e3a2dac tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:57.474545 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-282b2927-ea04-47ad-b11f-a13a5e3a2dac tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1314 microversion: 2.1 time: 0.750369 Jun 16 14:57:57.474838 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 156/321] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:56 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1314 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:57.489231 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-443e70d6-95e4-4696-805f-fb63b27b6757 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:57.489851 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-443e70d6-95e4-4696-805f-fb63b27b6757 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:57.507463 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-443e70d6-95e4-4696-805f-fb63b27b6757 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:57.509181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-443e70d6-95e4-4696-805f-fb63b27b6757 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:57.511832 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-443e70d6-95e4-4696-805f-fb63b27b6757 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:57.516694 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-443e70d6-95e4-4696-805f-fb63b27b6757 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:57.928394 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e2b49ff4-4a7f-4cd1-88cc-f5cdcf91cfc5 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0837cdf7-b7ff-4859-8dcf-2a8ebf3c5b13", "device": "/dev/sdb"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:57.944118 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e2b49ff4-4a7f-4cd1-88cc-f5cdcf91cfc5 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:57.969198 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e2b49ff4-4a7f-4cd1-88cc-f5cdcf91cfc5 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:57.973546 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e2b49ff4-4a7f-4cd1-88cc-f5cdcf91cfc5 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:57.975361 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e2b49ff4-4a7f-4cd1-88cc-f5cdcf91cfc5 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:57.976851 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e2b49ff4-4a7f-4cd1-88cc-f5cdcf91cfc5 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:57.996238 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:58.004494 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-443e70d6-95e4-4696-805f-fb63b27b6757 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:58.015707 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-443e70d6-95e4-4696-805f-fb63b27b6757 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1367 microversion: 2.1 time: 0.533003 Jun 16 14:57:58.019887 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 166/322] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:57 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1367 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:58.466907 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-aeb827d0-6c6f-457b-ad87-8e6d83f86979 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:58.477518 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-aeb827d0-6c6f-457b-ad87-8e6d83f86979 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:58.520106 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aeb827d0-6c6f-457b-ad87-8e6d83f86979 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:58.521897 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aeb827d0-6c6f-457b-ad87-8e6d83f86979 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:58.523563 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aeb827d0-6c6f-457b-ad87-8e6d83f86979 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:58.524392 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aeb827d0-6c6f-457b-ad87-8e6d83f86979 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:58.644381 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e2b49ff4-4a7f-4cd1-88cc-f5cdcf91cfc5 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "POST /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.728810 Jun 16 14:57:58.645286 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 157/323] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Jun 16 14:57:57 2022] POST /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984/os-volume_attachments => generated 194 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:58.681923 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-69b3d466-c08c-4b1d-b182-a3cf8b733bfe tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:58.683114 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-69b3d466-c08c-4b1d-b182-a3cf8b733bfe tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:58.722456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-69b3d466-c08c-4b1d-b182-a3cf8b733bfe tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:58.730233 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-69b3d466-c08c-4b1d-b182-a3cf8b733bfe tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:58.737048 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-69b3d466-c08c-4b1d-b182-a3cf8b733bfe tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:58.740157 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-69b3d466-c08c-4b1d-b182-a3cf8b733bfe tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:59.537013 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-69b3d466-c08c-4b1d-b182-a3cf8b733bfe tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:59.566392 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-69b3d466-c08c-4b1d-b182-a3cf8b733bfe tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1314 microversion: 2.1 time: 0.917931 Jun 16 14:57:59.567948 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 158/324] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:58 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1314 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:59.586392 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-01e8f4ff-5a90-4fdd-ba8e-0a15d3eeb6f8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:59.587601 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-01e8f4ff-5a90-4fdd-ba8e-0a15d3eeb6f8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:59.609073 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01e8f4ff-5a90-4fdd-ba8e-0a15d3eeb6f8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:59.615779 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01e8f4ff-5a90-4fdd-ba8e-0a15d3eeb6f8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:59.630735 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01e8f4ff-5a90-4fdd-ba8e-0a15d3eeb6f8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:59.631598 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01e8f4ff-5a90-4fdd-ba8e-0a15d3eeb6f8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:59.673968 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-aeb827d0-6c6f-457b-ad87-8e6d83f86979 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:59.689353 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-01e8f4ff-5a90-4fdd-ba8e-0a15d3eeb6f8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lazy-loading 'flavor' on Instance uuid 663488be-459f-4a58-aa1c-82be04813a2f {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:57:59.695798 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-aeb827d0-6c6f-457b-ad87-8e6d83f86979 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 1.236176 Jun 16 14:57:59.701560 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 167/325] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:58 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:59.728144 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b9b9f80e-185a-42a8-a1d9-86e53103636c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:59.730027 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b9b9f80e-185a-42a8-a1d9-86e53103636c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:59.744071 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b9b9f80e-185a-42a8-a1d9-86e53103636c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:59.744805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b9b9f80e-185a-42a8-a1d9-86e53103636c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:59.746212 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b9b9f80e-185a-42a8-a1d9-86e53103636c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:59.747109 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b9b9f80e-185a-42a8-a1d9-86e53103636c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:00.389324 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b9b9f80e-185a-42a8-a1d9-86e53103636c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:00.422148 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b9b9f80e-185a-42a8-a1d9-86e53103636c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1367 microversion: 2.1 time: 0.714058 Jun 16 14:58:00.422812 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 168/326] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:59 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1367 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:00.461554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-01e8f4ff-5a90-4fdd-ba8e-0a15d3eeb6f8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "POST /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/action" status: 202 len: 0 microversion: 2.20 time: 0.891922 Jun 16 14:58:00.467759 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 159/327] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Jun 16 14:57:59 2022] POST /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/action => generated 0 bytes in 896 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:58:00.478485 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-994d6436-3fa3-4c0f-98da-5f72cecbdc9d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:00.479355 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-994d6436-3fa3-4c0f-98da-5f72cecbdc9d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:00.497008 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-994d6436-3fa3-4c0f-98da-5f72cecbdc9d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:00.498671 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-994d6436-3fa3-4c0f-98da-5f72cecbdc9d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:00.501188 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-994d6436-3fa3-4c0f-98da-5f72cecbdc9d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:00.502931 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-994d6436-3fa3-4c0f-98da-5f72cecbdc9d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:00.596276 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-61964940-9496-454f-8658-f3b2ebc50e40 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:00.598335 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-61964940-9496-454f-8658-f3b2ebc50e40 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:00.613837 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-61964940-9496-454f-8658-f3b2ebc50e40 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:00.617337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-61964940-9496-454f-8658-f3b2ebc50e40 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:00.619149 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-61964940-9496-454f-8658-f3b2ebc50e40 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:00.622739 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-61964940-9496-454f-8658-f3b2ebc50e40 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:01.384299 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-994d6436-3fa3-4c0f-98da-5f72cecbdc9d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:01.395532 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-994d6436-3fa3-4c0f-98da-5f72cecbdc9d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:01.401271 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-994d6436-3fa3-4c0f-98da-5f72cecbdc9d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:01.405091 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-994d6436-3fa3-4c0f-98da-5f72cecbdc9d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 0.934834 Jun 16 14:58:01.405861 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 169/328] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:00 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:01.411719 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8c955f44-27b0-41f9-9b54-22f3a91e50a9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:01.412564 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-8c955f44-27b0-41f9-9b54-22f3a91e50a9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:01.419876 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c955f44-27b0-41f9-9b54-22f3a91e50a9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:01.420595 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c955f44-27b0-41f9-9b54-22f3a91e50a9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:01.422079 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c955f44-27b0-41f9-9b54-22f3a91e50a9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:01.422665 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c955f44-27b0-41f9-9b54-22f3a91e50a9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:01.449196 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-61964940-9496-454f-8658-f3b2ebc50e40 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:01.459181 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-61964940-9496-454f-8658-f3b2ebc50e40 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1498 microversion: 2.1 time: 0.867951 Jun 16 14:58:01.460113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 160/329] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:00 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1498 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:01.465019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-138c3e7b-6fa8-4750-8d9b-00b6d1669aeb req-593ad7ac-cf93-4fb5-b934-e83b2252d626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36bbbe9f-1cae-453f-9d25-38654f3e30a8", "tag": "b960162a-2e73-4c2d-9e31-9b643f7e6471"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:01.495054 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-138c3e7b-6fa8-4750-8d9b-00b6d1669aeb req-593ad7ac-cf93-4fb5-b934-e83b2252d626 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:01.495797 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-138c3e7b-6fa8-4750-8d9b-00b6d1669aeb req-593ad7ac-cf93-4fb5-b934-e83b2252d626 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:01.510761 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-138c3e7b-6fa8-4750-8d9b-00b6d1669aeb req-593ad7ac-cf93-4fb5-b934-e83b2252d626 service nova] Creating event network-changed:b960162a-2e73-4c2d-9e31-9b643f7e6471 for instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 on hv-cinder-83716 Jun 16 14:58:01.516239 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-138c3e7b-6fa8-4750-8d9b-00b6d1669aeb req-593ad7ac-cf93-4fb5-b934-e83b2252d626 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054628 Jun 16 14:58:01.517390 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 161/330] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:58:01.526502 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-568a16ea-f0b4-48ef-88a5-c92abc56ad4e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:01.527739 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-568a16ea-f0b4-48ef-88a5-c92abc56ad4e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:01.535546 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-568a16ea-f0b4-48ef-88a5-c92abc56ad4e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:01.536082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-568a16ea-f0b4-48ef-88a5-c92abc56ad4e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:01.536872 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-568a16ea-f0b4-48ef-88a5-c92abc56ad4e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:01.537310 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-568a16ea-f0b4-48ef-88a5-c92abc56ad4e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:01.840709 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-8c955f44-27b0-41f9-9b54-22f3a91e50a9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:01.853060 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8c955f44-27b0-41f9-9b54-22f3a91e50a9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.445739 Jun 16 14:58:01.866003 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 170/331] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:01 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:01.941921 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-568a16ea-f0b4-48ef-88a5-c92abc56ad4e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:01.951376 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-568a16ea-f0b4-48ef-88a5-c92abc56ad4e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1367 microversion: 2.1 time: 0.432963 Jun 16 14:58:01.954982 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 162/332] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:01 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1367 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:02.346932 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-058b7898-f591-4173-b17f-ae35f52b4186 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:02.347092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-058b7898-f591-4173-b17f-ae35f52b4186 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:02.366279 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-058b7898-f591-4173-b17f-ae35f52b4186 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:02.366749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-058b7898-f591-4173-b17f-ae35f52b4186 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:02.367587 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-058b7898-f591-4173-b17f-ae35f52b4186 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:02.367991 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-058b7898-f591-4173-b17f-ae35f52b4186 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:02.436641 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-53106de5-7a11-4fb3-b34d-eb6e649ce9a5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:02.437813 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-53106de5-7a11-4fb3-b34d-eb6e649ce9a5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:02.437986 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-058b7898-f591-4173-b17f-ae35f52b4186 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Going to try to terminate instance {{(pid=117443) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:58:02.482310 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-53106de5-7a11-4fb3-b34d-eb6e649ce9a5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:02.483113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-53106de5-7a11-4fb3-b34d-eb6e649ce9a5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:02.511290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-53106de5-7a11-4fb3-b34d-eb6e649ce9a5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:02.516691 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-53106de5-7a11-4fb3-b34d-eb6e649ce9a5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:02.633828 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-058b7898-f591-4173-b17f-ae35f52b4186 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "DELETE /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 204 len: 0 microversion: 2.1 time: 0.292061 Jun 16 14:58:02.635041 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 171/333] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 14:58:02 2022] DELETE /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:58:02.669702 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-aec6fbef-f447-4058-b9d4-fef8fc475244 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:02.673008 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-aec6fbef-f447-4058-b9d4-fef8fc475244 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:02.703638 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aec6fbef-f447-4058-b9d4-fef8fc475244 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:02.704275 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aec6fbef-f447-4058-b9d4-fef8fc475244 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:02.707309 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aec6fbef-f447-4058-b9d4-fef8fc475244 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:02.709427 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aec6fbef-f447-4058-b9d4-fef8fc475244 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:02.839516 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-53106de5-7a11-4fb3-b34d-eb6e649ce9a5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:02.876700 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-53106de5-7a11-4fb3-b34d-eb6e649ce9a5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:02.885288 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-53106de5-7a11-4fb3-b34d-eb6e649ce9a5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:02.888186 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-53106de5-7a11-4fb3-b34d-eb6e649ce9a5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 0.462987 Jun 16 14:58:02.889522 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 163/334] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:02 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:02.898689 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6802d218-922d-490d-a86b-e5e570039d0f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:02.899550 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6802d218-922d-490d-a86b-e5e570039d0f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:02.907854 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6802d218-922d-490d-a86b-e5e570039d0f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:02.908575 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6802d218-922d-490d-a86b-e5e570039d0f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:02.909607 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6802d218-922d-490d-a86b-e5e570039d0f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:02.910198 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6802d218-922d-490d-a86b-e5e570039d0f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:02.956427 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-aec6fbef-f447-4058-b9d4-fef8fc475244 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:02.966143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-aec6fbef-f447-4058-b9d4-fef8fc475244 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1504 microversion: 2.1 time: 0.324361 Jun 16 14:58:02.977013 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 172/335] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:02 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1504 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:02.984563 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a4a4d879-1ba6-4699-8b58-a8913533a702 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:02.987875 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a4a4d879-1ba6-4699-8b58-a8913533a702 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:03.004730 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a4a4d879-1ba6-4699-8b58-a8913533a702 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:03.005509 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a4a4d879-1ba6-4699-8b58-a8913533a702 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:03.012890 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a4a4d879-1ba6-4699-8b58-a8913533a702 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:03.014612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a4a4d879-1ba6-4699-8b58-a8913533a702 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:03.163548 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6802d218-922d-490d-a86b-e5e570039d0f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:03.188613 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6802d218-922d-490d-a86b-e5e570039d0f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.296548 Jun 16 14:58:03.191071 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 164/336] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:02 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:03.274990 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a4a4d879-1ba6-4699-8b58-a8913533a702 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:03.283413 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a4a4d879-1ba6-4699-8b58-a8913533a702 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1367 microversion: 2.1 time: 0.309515 Jun 16 14:58:03.284618 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 173/337] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:02 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:03.908588 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c3a416e1-7f94-43df-bb0a-fd477b1fdf7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:03.910051 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c3a416e1-7f94-43df-bb0a-fd477b1fdf7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:03.913902 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:03.922581 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c3a416e1-7f94-43df-bb0a-fd477b1fdf7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:03.923394 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c3a416e1-7f94-43df-bb0a-fd477b1fdf7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:03.924465 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c3a416e1-7f94-43df-bb0a-fd477b1fdf7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:03.924977 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c3a416e1-7f94-43df-bb0a-fd477b1fdf7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:04.003412 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-9d8f1552-3b77-4261-93b4-f2f9a2c5c1e9 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:04.006176 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-9d8f1552-3b77-4261-93b4-f2f9a2c5c1e9 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:04.012764 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=2 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:04.016334 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=16 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:04.030494 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9d8f1552-3b77-4261-93b4-f2f9a2c5c1e9 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:04.031455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9d8f1552-3b77-4261-93b4-f2f9a2c5c1e9 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:04.032838 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9d8f1552-3b77-4261-93b4-f2f9a2c5c1e9 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:04.034773 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9d8f1552-3b77-4261-93b4-f2f9a2c5c1e9 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:04.119445 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c3a416e1-7f94-43df-bb0a-fd477b1fdf7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:04.131415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c3a416e1-7f94-43df-bb0a-fd477b1fdf7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:04.133259 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c3a416e1-7f94-43df-bb0a-fd477b1fdf7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:04.135434 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c3a416e1-7f94-43df-bb0a-fd477b1fdf7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 0.231640 Jun 16 14:58:04.136895 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 165/338] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:03 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:04.207851 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-08cad20d-a2d1-4ad8-ae0d-f41de9cfc4e7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:04.209036 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-08cad20d-a2d1-4ad8-ae0d-f41de9cfc4e7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:04.229056 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-08cad20d-a2d1-4ad8-ae0d-f41de9cfc4e7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:04.229752 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-08cad20d-a2d1-4ad8-ae0d-f41de9cfc4e7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:04.230978 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-08cad20d-a2d1-4ad8-ae0d-f41de9cfc4e7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:04.231725 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-08cad20d-a2d1-4ad8-ae0d-f41de9cfc4e7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:04.314512 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-9d8f1552-3b77-4261-93b4-f2f9a2c5c1e9 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:04.346031 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-9d8f1552-3b77-4261-93b4-f2f9a2c5c1e9 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1504 microversion: 2.1 time: 0.341750 Jun 16 14:58:04.346889 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 174/339] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:03 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:04.361652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-0c93a0a3-2cdb-4b79-ac6b-d76275da5dfc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:04.370340 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-0c93a0a3-2cdb-4b79-ac6b-d76275da5dfc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:04.377826 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0c93a0a3-2cdb-4b79-ac6b-d76275da5dfc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:04.378275 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0c93a0a3-2cdb-4b79-ac6b-d76275da5dfc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:04.379050 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0c93a0a3-2cdb-4b79-ac6b-d76275da5dfc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:04.379473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0c93a0a3-2cdb-4b79-ac6b-d76275da5dfc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:04.403302 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:04.626564 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-08cad20d-a2d1-4ad8-ae0d-f41de9cfc4e7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:04.635282 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-08cad20d-a2d1-4ad8-ae0d-f41de9cfc4e7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.431647 Jun 16 14:58:04.641192 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 166/340] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:04 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:04.681621 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-0c93a0a3-2cdb-4b79-ac6b-d76275da5dfc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:04.695440 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-0c93a0a3-2cdb-4b79-ac6b-d76275da5dfc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1367 microversion: 2.1 time: 0.347363 Jun 16 14:58:04.696061 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 175/341] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:04 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1367 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:05.188570 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3c6c0362-bc8b-482e-8871-88589d7f0a84 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:05.192971 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3c6c0362-bc8b-482e-8871-88589d7f0a84 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:05.217884 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3c6c0362-bc8b-482e-8871-88589d7f0a84 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:05.218343 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3c6c0362-bc8b-482e-8871-88589d7f0a84 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:05.219144 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3c6c0362-bc8b-482e-8871-88589d7f0a84 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:05.219584 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3c6c0362-bc8b-482e-8871-88589d7f0a84 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:05.365332 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-2b07b37d-dfef-4144-9464-f275c2aaee49 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:05.366965 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-2b07b37d-dfef-4144-9464-f275c2aaee49 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:05.379471 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2b07b37d-dfef-4144-9464-f275c2aaee49 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:05.380224 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2b07b37d-dfef-4144-9464-f275c2aaee49 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:05.381193 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2b07b37d-dfef-4144-9464-f275c2aaee49 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:05.381773 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2b07b37d-dfef-4144-9464-f275c2aaee49 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:05.556396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3c6c0362-bc8b-482e-8871-88589d7f0a84 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:05.573078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3c6c0362-bc8b-482e-8871-88589d7f0a84 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:05.574508 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3c6c0362-bc8b-482e-8871-88589d7f0a84 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:05.580465 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3c6c0362-bc8b-482e-8871-88589d7f0a84 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 0.403420 Jun 16 14:58:05.581051 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 167/342] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:05 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:05.618524 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2b07b37d-dfef-4144-9464-f275c2aaee49 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:05.629008 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-2b07b37d-dfef-4144-9464-f275c2aaee49 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1504 microversion: 2.1 time: 0.267651 Jun 16 14:58:05.640181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 176/343] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:05 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1504 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:05.658255 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-218b8480-4fcd-413f-8add-d554a6af28b4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:05.658903 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-218b8480-4fcd-413f-8add-d554a6af28b4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:05.660847 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=74 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:05.669117 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-218b8480-4fcd-413f-8add-d554a6af28b4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:05.669878 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-218b8480-4fcd-413f-8add-d554a6af28b4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:05.671856 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-218b8480-4fcd-413f-8add-d554a6af28b4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:05.683495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-218b8480-4fcd-413f-8add-d554a6af28b4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:05.715612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f4896890-f1ca-4423-abc1-2aa269c447d6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:05.716811 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f4896890-f1ca-4423-abc1-2aa269c447d6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:05.728522 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f4896890-f1ca-4423-abc1-2aa269c447d6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:05.730730 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f4896890-f1ca-4423-abc1-2aa269c447d6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:05.734341 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f4896890-f1ca-4423-abc1-2aa269c447d6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:05.736149 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f4896890-f1ca-4423-abc1-2aa269c447d6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:06.184053 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-218b8480-4fcd-413f-8add-d554a6af28b4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:06.199163 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-218b8480-4fcd-413f-8add-d554a6af28b4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.545314 Jun 16 14:58:06.212256 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 168/344] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:05 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:06.230451 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f4896890-f1ca-4423-abc1-2aa269c447d6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:06.245734 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f4896890-f1ca-4423-abc1-2aa269c447d6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1367 microversion: 2.1 time: 0.535929 Jun 16 14:58:06.247706 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 177/345] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:05 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1367 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:06.601117 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6347468e-241d-4f7a-91ed-7c591376c89f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:06.603023 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6347468e-241d-4f7a-91ed-7c591376c89f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:06.615062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6347468e-241d-4f7a-91ed-7c591376c89f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:06.617978 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6347468e-241d-4f7a-91ed-7c591376c89f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:06.619119 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6347468e-241d-4f7a-91ed-7c591376c89f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:06.619749 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6347468e-241d-4f7a-91ed-7c591376c89f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:06.647258 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-5b159ee1-1b53-4bc8-bcbd-7bf20c12572b tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:06.648192 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-5b159ee1-1b53-4bc8-bcbd-7bf20c12572b tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:06.660018 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5b159ee1-1b53-4bc8-bcbd-7bf20c12572b tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:06.660475 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5b159ee1-1b53-4bc8-bcbd-7bf20c12572b tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:06.661258 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5b159ee1-1b53-4bc8-bcbd-7bf20c12572b tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:06.661686 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5b159ee1-1b53-4bc8-bcbd-7bf20c12572b tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:08.472295 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6347468e-241d-4f7a-91ed-7c591376c89f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:08.489097 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6347468e-241d-4f7a-91ed-7c591376c89f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:08.492859 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6347468e-241d-4f7a-91ed-7c591376c89f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:08.497321 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6347468e-241d-4f7a-91ed-7c591376c89f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 1.900214 Jun 16 14:58:08.502286 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 169/346] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:06 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:08.539788 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-bd04df96-32b3-45bb-a42e-c3f53b045a91 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:08.542542 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-bd04df96-32b3-45bb-a42e-c3f53b045a91 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:08.572410 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bd04df96-32b3-45bb-a42e-c3f53b045a91 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:08.580475 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bd04df96-32b3-45bb-a42e-c3f53b045a91 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:08.591063 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bd04df96-32b3-45bb-a42e-c3f53b045a91 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:08.591999 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bd04df96-32b3-45bb-a42e-c3f53b045a91 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:08.622385 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-5b159ee1-1b53-4bc8-bcbd-7bf20c12572b tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:08.642620 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-5b159ee1-1b53-4bc8-bcbd-7bf20c12572b tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1504 microversion: 2.1 time: 1.998718 Jun 16 14:58:08.643915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 178/347] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:06 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1504 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:08.657376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-feb208f2-01fd-4d82-8a25-86a27137c4ba tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:08.665405 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-feb208f2-01fd-4d82-8a25-86a27137c4ba tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:08.681814 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-feb208f2-01fd-4d82-8a25-86a27137c4ba tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:08.695172 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-feb208f2-01fd-4d82-8a25-86a27137c4ba tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:08.696478 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-feb208f2-01fd-4d82-8a25-86a27137c4ba tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:08.697078 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-feb208f2-01fd-4d82-8a25-86a27137c4ba tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:09.245133 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-bd04df96-32b3-45bb-a42e-c3f53b045a91 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:09.254207 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-bd04df96-32b3-45bb-a42e-c3f53b045a91 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.730284 Jun 16 14:58:09.254789 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 170/348] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:08 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:09.265771 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-841bd202-e4b9-44d8-80c5-051192e00637 req-0ab4c49d-50da-4792-83d5-73fa869c813b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "000799b2-d8b1-4e97-8de4-9a6f42cd0596", "name": "network-vif-deleted", "tag": "8c617ea8-e144-480c-8ec3-878436728ec7"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:09.305518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-841bd202-e4b9-44d8-80c5-051192e00637 req-0ab4c49d-50da-4792-83d5-73fa869c813b service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:09.308332 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-841bd202-e4b9-44d8-80c5-051192e00637 req-0ab4c49d-50da-4792-83d5-73fa869c813b service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:09.322779 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-feb208f2-01fd-4d82-8a25-86a27137c4ba tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:09.335728 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-feb208f2-01fd-4d82-8a25-86a27137c4ba tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1367 microversion: 2.1 time: 0.686555 Jun 16 14:58:09.352540 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 179/349] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:08 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1367 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:09.363824 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-12ca4b0b-fe1e-4920-b618-42e35cb2e4ee req-3a562b27-7c5b-4b9b-a600-a9e3971a1271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36bbbe9f-1cae-453f-9d25-38654f3e30a8", "name": "network-vif-plugged", "status": "completed", "tag": "b960162a-2e73-4c2d-9e31-9b643f7e6471"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:09.364821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:09.372942 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-841bd202-e4b9-44d8-80c5-051192e00637 req-0ab4c49d-50da-4792-83d5-73fa869c813b service nova] Creating event network-vif-deleted:8c617ea8-e144-480c-8ec3-878436728ec7 for instance 000799b2-d8b1-4e97-8de4-9a6f42cd0596 on hv-cinder-83716 Jun 16 14:58:09.379969 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-841bd202-e4b9-44d8-80c5-051192e00637 req-0ab4c49d-50da-4792-83d5-73fa869c813b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120214 Jun 16 14:58:09.384864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-12ca4b0b-fe1e-4920-b618-42e35cb2e4ee req-3a562b27-7c5b-4b9b-a600-a9e3971a1271 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:09.389809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 171/350] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:58:09.390714 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-12ca4b0b-fe1e-4920-b618-42e35cb2e4ee req-3a562b27-7c5b-4b9b-a600-a9e3971a1271 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:09.406870 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-12ca4b0b-fe1e-4920-b618-42e35cb2e4ee req-3a562b27-7c5b-4b9b-a600-a9e3971a1271 service nova] Creating event network-vif-plugged:b960162a-2e73-4c2d-9e31-9b643f7e6471 for instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 on hv-cinder-83716 Jun 16 14:58:09.414198 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-12ca4b0b-fe1e-4920-b618-42e35cb2e4ee req-3a562b27-7c5b-4b9b-a600-a9e3971a1271 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058969 Jun 16 14:58:09.416167 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 180/351] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:58:09.533741 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-40baec52-307b-4023-83b2-0f068bdee9d3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:09.534470 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-40baec52-307b-4023-83b2-0f068bdee9d3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:09.549339 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-40baec52-307b-4023-83b2-0f068bdee9d3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:09.549789 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-40baec52-307b-4023-83b2-0f068bdee9d3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:09.550571 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-40baec52-307b-4023-83b2-0f068bdee9d3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:09.550997 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-40baec52-307b-4023-83b2-0f068bdee9d3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:09.663770 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c49a2b1d-a72d-4429-9ff2-59d3e7ade8e0 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:09.664575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c49a2b1d-a72d-4429-9ff2-59d3e7ade8e0 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:09.673923 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c49a2b1d-a72d-4429-9ff2-59d3e7ade8e0 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:09.678807 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c49a2b1d-a72d-4429-9ff2-59d3e7ade8e0 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:09.682229 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c49a2b1d-a72d-4429-9ff2-59d3e7ade8e0 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:09.682878 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c49a2b1d-a72d-4429-9ff2-59d3e7ade8e0 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:09.895307 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c49a2b1d-a72d-4429-9ff2-59d3e7ade8e0 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:09.917089 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c49a2b1d-a72d-4429-9ff2-59d3e7ade8e0 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1462 microversion: 2.1 time: 0.256908 Jun 16 14:58:09.919986 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 181/352] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:09 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1462 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:09.954816 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-40baec52-307b-4023-83b2-0f068bdee9d3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:09.964793 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-40baec52-307b-4023-83b2-0f068bdee9d3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:09.966621 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-40baec52-307b-4023-83b2-0f068bdee9d3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:09.968533 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-40baec52-307b-4023-83b2-0f068bdee9d3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 0.448405 Jun 16 14:58:09.979737 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 172/353] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:09 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:10.312934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-5f3cf3d6-373f-4cf7-ad78-b0203cb96102 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:10.315240 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-5f3cf3d6-373f-4cf7-ad78-b0203cb96102 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:10.322368 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5f3cf3d6-373f-4cf7-ad78-b0203cb96102 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:10.323382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5f3cf3d6-373f-4cf7-ad78-b0203cb96102 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:10.324703 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5f3cf3d6-373f-4cf7-ad78-b0203cb96102 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:10.325354 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5f3cf3d6-373f-4cf7-ad78-b0203cb96102 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:10.361475 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e59e9a21-8a0c-4cf3-9797-c9835942fbf5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:10.362087 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e59e9a21-8a0c-4cf3-9797-c9835942fbf5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:10.373623 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e59e9a21-8a0c-4cf3-9797-c9835942fbf5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:10.375634 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e59e9a21-8a0c-4cf3-9797-c9835942fbf5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:10.377412 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e59e9a21-8a0c-4cf3-9797-c9835942fbf5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:10.378143 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e59e9a21-8a0c-4cf3-9797-c9835942fbf5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:10.697812 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-5f3cf3d6-373f-4cf7-ad78-b0203cb96102 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:10.718549 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-5f3cf3d6-373f-4cf7-ad78-b0203cb96102 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.437685 Jun 16 14:58:10.718549 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 182/354] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:10 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:10.751901 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e59e9a21-8a0c-4cf3-9797-c9835942fbf5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:10.765125 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e59e9a21-8a0c-4cf3-9797-c9835942fbf5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1367 microversion: 2.1 time: 0.405211 Jun 16 14:58:10.765125 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 173/355] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:10 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1367 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:10.938335 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-679fda36-10fa-44f3-866a-b03bfa512ee1 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:10.938944 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-679fda36-10fa-44f3-866a-b03bfa512ee1 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:10.945582 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-679fda36-10fa-44f3-866a-b03bfa512ee1 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:10.946375 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-679fda36-10fa-44f3-866a-b03bfa512ee1 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:10.947151 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-679fda36-10fa-44f3-866a-b03bfa512ee1 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:10.947584 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-679fda36-10fa-44f3-866a-b03bfa512ee1 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:10.988090 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f8ddf8dd-668d-4ae8-b3a8-6282bfd4b826 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:10.991977 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f8ddf8dd-668d-4ae8-b3a8-6282bfd4b826 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:11.002484 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f8ddf8dd-668d-4ae8-b3a8-6282bfd4b826 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:11.003221 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f8ddf8dd-668d-4ae8-b3a8-6282bfd4b826 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:11.004188 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f8ddf8dd-668d-4ae8-b3a8-6282bfd4b826 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:11.004780 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f8ddf8dd-668d-4ae8-b3a8-6282bfd4b826 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:11.027818 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-679fda36-10fa-44f3-866a-b03bfa512ee1 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:11.036678 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-679fda36-10fa-44f3-866a-b03bfa512ee1 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1462 microversion: 2.1 time: 0.102702 Jun 16 14:58:11.037749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 183/356] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:10 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1462 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:11.164954 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f8ddf8dd-668d-4ae8-b3a8-6282bfd4b826 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:11.177574 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f8ddf8dd-668d-4ae8-b3a8-6282bfd4b826 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:11.179226 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f8ddf8dd-668d-4ae8-b3a8-6282bfd4b826 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:11.180435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f8ddf8dd-668d-4ae8-b3a8-6282bfd4b826 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 0.197469 Jun 16 14:58:11.181206 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 174/357] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:10 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:11.741731 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f1519fc7-804c-41e1-a2d5-1e994ec27661 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:11.742397 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f1519fc7-804c-41e1-a2d5-1e994ec27661 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:11.749939 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f1519fc7-804c-41e1-a2d5-1e994ec27661 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:11.750630 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f1519fc7-804c-41e1-a2d5-1e994ec27661 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:11.751601 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f1519fc7-804c-41e1-a2d5-1e994ec27661 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:11.752204 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f1519fc7-804c-41e1-a2d5-1e994ec27661 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:11.778536 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9ad9b595-8738-4124-ad64-56cdcd12cf43 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:11.779133 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9ad9b595-8738-4124-ad64-56cdcd12cf43 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:11.790298 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9ad9b595-8738-4124-ad64-56cdcd12cf43 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:11.794582 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9ad9b595-8738-4124-ad64-56cdcd12cf43 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:11.795573 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9ad9b595-8738-4124-ad64-56cdcd12cf43 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:11.798045 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9ad9b595-8738-4124-ad64-56cdcd12cf43 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:12.224096 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f1519fc7-804c-41e1-a2d5-1e994ec27661 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:12.234665 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f1519fc7-804c-41e1-a2d5-1e994ec27661 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.495418 Jun 16 14:58:12.238237 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 184/358] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:11 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:12.244488 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f4daf65c-f143-48cc-bbd1-735238a331e0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-130482265", "imageRef": "f2f37ffa-db20-478d-84c0-b429a987933c", "flavorRef": "452"}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:12.258921 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9ad9b595-8738-4124-ad64-56cdcd12cf43 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:12.267957 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9ad9b595-8738-4124-ad64-56cdcd12cf43 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1367 microversion: 2.1 time: 0.493122 Jun 16 14:58:12.268635 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 175/359] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:11 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1367 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:12.285145 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-438ff02d-748f-48e0-abfa-ff3cafc0de91 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:12.286157 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-438ff02d-748f-48e0-abfa-ff3cafc0de91 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:12.303507 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-438ff02d-748f-48e0-abfa-ff3cafc0de91 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:12.306212 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-438ff02d-748f-48e0-abfa-ff3cafc0de91 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:12.309569 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-438ff02d-748f-48e0-abfa-ff3cafc0de91 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:12.312096 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-438ff02d-748f-48e0-abfa-ff3cafc0de91 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:12.344828 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.network.neutron [None req-f4daf65c-f143-48cc-bbd1-735238a331e0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] validate_networks() for None {{(pid=117443) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:58:12.368365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-438ff02d-748f-48e0-abfa-ff3cafc0de91 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:12.369408 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-438ff02d-748f-48e0-abfa-ff3cafc0de91 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:12.370336 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-438ff02d-748f-48e0-abfa-ff3cafc0de91 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lazy-loading 'fault' on Instance uuid 000799b2-d8b1-4e97-8de4-9a6f42cd0596 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:58:12.498039 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-438ff02d-748f-48e0-abfa-ff3cafc0de91 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6824c7c97414a72bec98f8c819356ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e827220104db5a73cf01d58418648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:12.509288 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-438ff02d-748f-48e0-abfa-ff3cafc0de91 tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 200 len: 1304 microversion: 2.1 time: 0.239356 Jun 16 14:58:12.510186 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 176/360] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:12 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 1304 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:12.528919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ec54a7a0-1131-4d3f-8fe7-a49c6edee1fa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:12.531315 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ec54a7a0-1131-4d3f-8fe7-a49c6edee1fa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:12.541422 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ec54a7a0-1131-4d3f-8fe7-a49c6edee1fa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:12.542146 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ec54a7a0-1131-4d3f-8fe7-a49c6edee1fa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:12.544234 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ec54a7a0-1131-4d3f-8fe7-a49c6edee1fa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:12.544860 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ec54a7a0-1131-4d3f-8fe7-a49c6edee1fa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:13.045575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-f4daf65c-f143-48cc-bbd1-735238a331e0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Flavor limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:58:13.046767 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-f4daf65c-f143-48cc-bbd1-735238a331e0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Image limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:58:13.051136 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ec54a7a0-1131-4d3f-8fe7-a49c6edee1fa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:13.055254 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-f4daf65c-f143-48cc-bbd1-735238a331e0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Flavor pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:58:13.056039 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-f4daf65c-f143-48cc-bbd1-735238a331e0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Image pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:58:13.056681 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-f4daf65c-f143-48cc-bbd1-735238a331e0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:58:13.066880 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ec54a7a0-1131-4d3f-8fe7-a49c6edee1fa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:13.069603 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ec54a7a0-1131-4d3f-8fe7-a49c6edee1fa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:13.071126 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ec54a7a0-1131-4d3f-8fe7-a49c6edee1fa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 0.559518 Jun 16 14:58:13.072203 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f4daf65c-f143-48cc-bbd1-735238a331e0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:13.072521 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 177/361] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:12 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:13.072911 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f4daf65c-f143-48cc-bbd1-735238a331e0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:13.073785 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f4daf65c-f143-48cc-bbd1-735238a331e0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:13.074214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f4daf65c-f143-48cc-bbd1-735238a331e0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:13.114626 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-f4daf65c-f143-48cc-bbd1-735238a331e0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Getting quotas for project afad594036e64abf84514cb21e5f8d75. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:58:13.124778 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-f4daf65c-f143-48cc-bbd1-735238a331e0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Getting quotas for user 7237fbeb4fb64eecbef78b83974c09c8 and project afad594036e64abf84514cb21e5f8d75. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:58:13.126622 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:13.144741 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f4daf65c-f143-48cc-bbd1-735238a331e0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Going to run 1 instances... {{(pid=117443) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:58:13.147196 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f4daf65c-f143-48cc-bbd1-735238a331e0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2f37ffa-db20-478d-84c0-b429a987933c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:58:13.198602 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f4daf65c-f143-48cc-bbd1-735238a331e0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.959033 Jun 16 14:58:13.199347 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 185/362] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 14:58:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:58:13.209776 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7c24b54d-7da9-4085-ad64-4d438353a474 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:13.210665 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7c24b54d-7da9-4085-ad64-4d438353a474 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:13.261301 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6d701d43-a877-4eee-bc90-a6bf8cc31e11 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:13.262300 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6d701d43-a877-4eee-bc90-a6bf8cc31e11 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:13.288748 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6d701d43-a877-4eee-bc90-a6bf8cc31e11 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:13.289651 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6d701d43-a877-4eee-bc90-a6bf8cc31e11 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:13.291089 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6d701d43-a877-4eee-bc90-a6bf8cc31e11 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:13.291751 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6d701d43-a877-4eee-bc90-a6bf8cc31e11 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:13.326890 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7c24b54d-7da9-4085-ad64-4d438353a474 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:13.334882 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7c24b54d-7da9-4085-ad64-4d438353a474 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1214 microversion: 2.1 time: 0.129129 Jun 16 14:58:13.349254 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 178/363] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:13 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1214 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:13.368014 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-35a84d0e-a710-4ddd-ab8c-6068ff84ffee tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:13.369180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-35a84d0e-a710-4ddd-ab8c-6068ff84ffee tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:13.385312 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-35a84d0e-a710-4ddd-ab8c-6068ff84ffee tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:13.386066 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-35a84d0e-a710-4ddd-ab8c-6068ff84ffee tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:13.386858 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-35a84d0e-a710-4ddd-ab8c-6068ff84ffee tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:13.387452 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-35a84d0e-a710-4ddd-ab8c-6068ff84ffee tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:13.597675 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6d701d43-a877-4eee-bc90-a6bf8cc31e11 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:13.620307 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-35a84d0e-a710-4ddd-ab8c-6068ff84ffee tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:13.629602 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6d701d43-a877-4eee-bc90-a6bf8cc31e11 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.371488 Jun 16 14:58:13.633300 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 186/364] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:13 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:13.638883 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-35a84d0e-a710-4ddd-ab8c-6068ff84ffee tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1367 microversion: 2.1 time: 0.287921 Jun 16 14:58:13.648479 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 179/365] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:13 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:13.654488 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-af9b04cd-e1a9-47e7-8e4b-180c55cbc2dd tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:13.656592 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-af9b04cd-e1a9-47e7-8e4b-180c55cbc2dd tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] [instance: 000799b2-d8b1-4e97-8de4-9a6f42cd0596] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:13.676676 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-af9b04cd-e1a9-47e7-8e4b-180c55cbc2dd tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:13.677671 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-af9b04cd-e1a9-47e7-8e4b-180c55cbc2dd tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:13.679571 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-af9b04cd-e1a9-47e7-8e4b-180c55cbc2dd tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:13.680278 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-af9b04cd-e1a9-47e7-8e4b-180c55cbc2dd tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:13.712343 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-af9b04cd-e1a9-47e7-8e4b-180c55cbc2dd tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] HTTP exception thrown: Instance 000799b2-d8b1-4e97-8de4-9a6f42cd0596 could not be found. Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-af9b04cd-e1a9-47e7-8e4b-180c55cbc2dd tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Request method failure captured: Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 HTTP/1.1 Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0TFa1JfrDdMnRhgxvF5a4RqO5OPtEatOh5aymp7U3s7xCepC7-nOwbA29iqR7eoyoKQiF6fWo_2lisBb6J2y99SKlzkSyHiIBse1XaEEDDzITtFuhEW2Ay_DhGko8F2i8sh7busn_KxtVu1nvlxdpTpGHkkxEpN2frcqc4ZgG9lEBQ Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 8e9e827220104db5a73cf01d58418648 Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-VolumesActionsTest-1632504662 Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 14:58:13.716223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 14:58:13.719032 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/8e9e827220104db5a73cf01d58418648"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8e9e827220104db5a73cf01d58418648"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_8e9e827220104db5a73cf01d58418648"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/8e9e827220104db5a73cf01d58418648"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:58:13.719032 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-VolumesActionsTest-1632504662 Jun 16 14:58:13.719032 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 8e9e827220104db5a73cf01d58418648 Jun 16 14:58:13.719032 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-VolumesActionsTest-1632504662 Jun 16 14:58:13.719032 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-VolumesActionsTest-1632504662-project Jun 16 14:58:13.719032 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 14:58:13.719032 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 14:58:13.719032 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: d6824c7c97414a72bec98f8c819356ff Jun 16 14:58:13.719032 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-VolumesActionsTest-1632504662-project Jun 16 14:58:13.719032 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 14:58:13.719032 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance 000799b2-d8b1-4e97-8de4-9a6f42cd0596 could not be found. Jun 16 14:58:13.719032 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': '000799b2-d8b1-4e97-8de4-9a6f42cd0596'} Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 000799b2-d8b1-4e97-8de4-9a6f42cd0596 could not be found. Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:58:13.721291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:58:13.722803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:58:13.722803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:58:13.722803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:58:13.722803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:58:13.722803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:58:13.722803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:58:13.722803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:58:13.722803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 000799b2-d8b1-4e97-8de4-9a6f42cd0596 could not be found. Jun 16 14:58:13.722803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:58:13.722803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:58:13.722803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:58:13.722803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:58:13.722803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:58:13.722803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:58:13.722803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:58:13.722803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:58:13.722803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 000799b2-d8b1-4e97-8de4-9a6f42cd0596 could not be found. Jun 16 14:58:13.722803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:58:13.728801 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-af9b04cd-e1a9-47e7-8e4b-180c55cbc2dd tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] Returning 404 to user: Instance 000799b2-d8b1-4e97-8de4-9a6f42cd0596 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:58:13.730252 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-af9b04cd-e1a9-47e7-8e4b-180c55cbc2dd tempest-VolumesActionsTest-1632504662 tempest-VolumesActionsTest-1632504662-project] 10.222.0.76 "GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596" status: 404 len: 111 microversion: 2.1 time: 0.092524 Jun 16 14:58:13.735159 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 187/366] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:13 2022] GET /compute/v2.1/servers/000799b2-d8b1-4e97-8de4-9a6f42cd0596 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:58:14.094086 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-071b19fa-0718-437e-b442-58d3d5d9450d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:14.095364 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-071b19fa-0718-437e-b442-58d3d5d9450d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:14.105417 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-071b19fa-0718-437e-b442-58d3d5d9450d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:14.106122 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-071b19fa-0718-437e-b442-58d3d5d9450d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:14.107084 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-071b19fa-0718-437e-b442-58d3d5d9450d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:14.107696 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-071b19fa-0718-437e-b442-58d3d5d9450d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:14.325913 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-071b19fa-0718-437e-b442-58d3d5d9450d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:14.335080 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-071b19fa-0718-437e-b442-58d3d5d9450d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:14.337185 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-071b19fa-0718-437e-b442-58d3d5d9450d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:14.338732 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-071b19fa-0718-437e-b442-58d3d5d9450d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 0.250645 Jun 16 14:58:14.352362 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 180/367] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:14 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:14.357781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-355889bf-b8d2-4aaa-bf5f-74782c0755eb tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:14.358640 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-355889bf-b8d2-4aaa-bf5f-74782c0755eb tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:14.373444 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-355889bf-b8d2-4aaa-bf5f-74782c0755eb tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:14.375513 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-355889bf-b8d2-4aaa-bf5f-74782c0755eb tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:14.376413 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-355889bf-b8d2-4aaa-bf5f-74782c0755eb tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:14.378097 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-355889bf-b8d2-4aaa-bf5f-74782c0755eb tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:14.470856 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-355889bf-b8d2-4aaa-bf5f-74782c0755eb tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:14.480141 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-355889bf-b8d2-4aaa-bf5f-74782c0755eb tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1218 microversion: 2.1 time: 0.126612 Jun 16 14:58:14.490151 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 188/368] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:14 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:14.663090 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7e5f6922-26d0-476f-82c5-5c248b1e8cbc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:14.663262 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-66830f70-9502-42b3-97c9-32422a95ec70 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:14.663830 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-66830f70-9502-42b3-97c9-32422a95ec70 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:14.664479 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7e5f6922-26d0-476f-82c5-5c248b1e8cbc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:14.673343 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-66830f70-9502-42b3-97c9-32422a95ec70 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:14.675767 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e5f6922-26d0-476f-82c5-5c248b1e8cbc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:14.676423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-66830f70-9502-42b3-97c9-32422a95ec70 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:14.677693 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-66830f70-9502-42b3-97c9-32422a95ec70 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:14.678125 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-66830f70-9502-42b3-97c9-32422a95ec70 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:14.680217 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e5f6922-26d0-476f-82c5-5c248b1e8cbc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:14.681656 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e5f6922-26d0-476f-82c5-5c248b1e8cbc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:14.682256 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e5f6922-26d0-476f-82c5-5c248b1e8cbc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:14.953578 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-66830f70-9502-42b3-97c9-32422a95ec70 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:14.961532 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7e5f6922-26d0-476f-82c5-5c248b1e8cbc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:14.964104 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-66830f70-9502-42b3-97c9-32422a95ec70 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.306316 Jun 16 14:58:14.964823 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 189/369] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:14 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:14.973357 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7e5f6922-26d0-476f-82c5-5c248b1e8cbc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1367 microversion: 2.1 time: 0.315409 Jun 16 14:58:14.982922 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 181/370] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:14 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:15.364211 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-0b4a6d5c-82d1-4ab0-9dff-dcc8502d199e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:15.365692 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-0b4a6d5c-82d1-4ab0-9dff-dcc8502d199e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:15.373227 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0b4a6d5c-82d1-4ab0-9dff-dcc8502d199e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:15.374493 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0b4a6d5c-82d1-4ab0-9dff-dcc8502d199e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:15.375479 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0b4a6d5c-82d1-4ab0-9dff-dcc8502d199e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:15.376058 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0b4a6d5c-82d1-4ab0-9dff-dcc8502d199e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:15.497009 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f1964363-ead4-452e-af43-21842056babb tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:15.498352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f1964363-ead4-452e-af43-21842056babb tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:15.512379 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f1964363-ead4-452e-af43-21842056babb tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:15.513132 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f1964363-ead4-452e-af43-21842056babb tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:15.514127 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f1964363-ead4-452e-af43-21842056babb tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:15.515324 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f1964363-ead4-452e-af43-21842056babb tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:15.569725 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-0b4a6d5c-82d1-4ab0-9dff-dcc8502d199e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:15.580230 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-0b4a6d5c-82d1-4ab0-9dff-dcc8502d199e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:15.582142 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-0b4a6d5c-82d1-4ab0-9dff-dcc8502d199e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:15.583846 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-0b4a6d5c-82d1-4ab0-9dff-dcc8502d199e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 0.223643 Jun 16 14:58:15.584667 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 190/371] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:15 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:15.602017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f1964363-ead4-452e-af43-21842056babb tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:15.612465 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f1964363-ead4-452e-af43-21842056babb tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1218 microversion: 2.1 time: 0.119160 Jun 16 14:58:15.622012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 182/372] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:15 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:15.982247 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-15f54ad2-0854-4e6a-abfb-46f41388a0ee tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:15.982845 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-15f54ad2-0854-4e6a-abfb-46f41388a0ee tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:15.990348 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-dc67cb35-e2d9-44f5-970f-4459127dca9d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:15.991244 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-dc67cb35-e2d9-44f5-970f-4459127dca9d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:15.994028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-15f54ad2-0854-4e6a-abfb-46f41388a0ee tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:15.994679 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-15f54ad2-0854-4e6a-abfb-46f41388a0ee tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:15.995520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-15f54ad2-0854-4e6a-abfb-46f41388a0ee tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:15.996155 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-15f54ad2-0854-4e6a-abfb-46f41388a0ee tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:16.000335 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dc67cb35-e2d9-44f5-970f-4459127dca9d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:16.001052 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dc67cb35-e2d9-44f5-970f-4459127dca9d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:16.002359 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dc67cb35-e2d9-44f5-970f-4459127dca9d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:16.002940 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dc67cb35-e2d9-44f5-970f-4459127dca9d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:16.222822 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-15f54ad2-0854-4e6a-abfb-46f41388a0ee tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:16.241565 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-15f54ad2-0854-4e6a-abfb-46f41388a0ee tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.262545 Jun 16 14:58:16.242653 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 191/373] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:15 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:16.248578 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-dc67cb35-e2d9-44f5-970f-4459127dca9d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:16.257370 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-dc67cb35-e2d9-44f5-970f-4459127dca9d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1367 microversion: 2.1 time: 0.270758 Jun 16 14:58:16.261416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 183/374] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:15 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:16.604362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-2a2b2787-f2b7-4797-9d1f-a849c0ce96f8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:16.605612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-2a2b2787-f2b7-4797-9d1f-a849c0ce96f8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:16.612973 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2a2b2787-f2b7-4797-9d1f-a849c0ce96f8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:16.613770 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2a2b2787-f2b7-4797-9d1f-a849c0ce96f8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:16.615006 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2a2b2787-f2b7-4797-9d1f-a849c0ce96f8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:16.615669 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2a2b2787-f2b7-4797-9d1f-a849c0ce96f8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:16.630072 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-fc1785d9-02ba-4904-a4b6-eb38c5b05225 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:16.631313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-fc1785d9-02ba-4904-a4b6-eb38c5b05225 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:16.638888 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fc1785d9-02ba-4904-a4b6-eb38c5b05225 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:16.640166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fc1785d9-02ba-4904-a4b6-eb38c5b05225 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:16.641832 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fc1785d9-02ba-4904-a4b6-eb38c5b05225 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:16.642922 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fc1785d9-02ba-4904-a4b6-eb38c5b05225 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:16.750867 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fc1785d9-02ba-4904-a4b6-eb38c5b05225 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:16.762364 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-fc1785d9-02ba-4904-a4b6-eb38c5b05225 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1218 microversion: 2.1 time: 0.137141 Jun 16 14:58:16.763294 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 184/375] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:16 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:16.824069 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2a2b2787-f2b7-4797-9d1f-a849c0ce96f8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:16.833625 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2a2b2787-f2b7-4797-9d1f-a849c0ce96f8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:16.835203 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2a2b2787-f2b7-4797-9d1f-a849c0ce96f8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:16.836534 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-2a2b2787-f2b7-4797-9d1f-a849c0ce96f8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 0.237551 Jun 16 14:58:16.837643 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 192/376] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:16 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:17.265266 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-dca7b54d-20f3-447a-9ac8-62171d48bec9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:17.266282 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-dca7b54d-20f3-447a-9ac8-62171d48bec9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:17.277347 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3c128d38-71ec-4067-9009-3c8cac256e06 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:17.279018 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-3c128d38-71ec-4067-9009-3c8cac256e06 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:17.289106 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3c128d38-71ec-4067-9009-3c8cac256e06 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:17.289568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3c128d38-71ec-4067-9009-3c8cac256e06 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:17.290336 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3c128d38-71ec-4067-9009-3c8cac256e06 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:17.290778 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3c128d38-71ec-4067-9009-3c8cac256e06 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:17.303554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dca7b54d-20f3-447a-9ac8-62171d48bec9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:17.304216 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dca7b54d-20f3-447a-9ac8-62171d48bec9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:17.314586 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dca7b54d-20f3-447a-9ac8-62171d48bec9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:17.315086 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dca7b54d-20f3-447a-9ac8-62171d48bec9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:17.549458 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-dca7b54d-20f3-447a-9ac8-62171d48bec9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:17.557676 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-dca7b54d-20f3-447a-9ac8-62171d48bec9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.298799 Jun 16 14:58:17.558498 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 185/377] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:17 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:17.573817 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3c128d38-71ec-4067-9009-3c8cac256e06 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:17.582126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3c128d38-71ec-4067-9009-3c8cac256e06 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1367 microversion: 2.1 time: 0.310665 Jun 16 14:58:17.583712 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 193/378] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:17 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:17.781485 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-56730da1-4913-4e0c-819c-1b42a6c12195 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:17.782479 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-56730da1-4913-4e0c-819c-1b42a6c12195 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:17.790169 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-56730da1-4913-4e0c-819c-1b42a6c12195 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:17.790625 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-56730da1-4913-4e0c-819c-1b42a6c12195 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:17.791429 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-56730da1-4913-4e0c-819c-1b42a6c12195 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:17.791896 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-56730da1-4913-4e0c-819c-1b42a6c12195 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:17.841383 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-36bdf82e-359d-4335-a3a3-703f1c5af588 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Action: 'create', calling method: .version_select at 0x7f33e3c27ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1123455784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBr6H+tW2oj7Ct7ruJ/21jDYWDatzq8fAVW0S3S7eS71FuuuMW1a2lTr4AhSUHIu8Q42ZNPqsqshQreU7FB3WxVFRXcB4bII6/dWJWelQZC2e1dbnL4Op9aoxtDC6zBwtQ=="}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:17.856990 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-36bdf82e-359d-4335-a3a3-703f1c5af588 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Getting quotas for project 1b370efdc42b4a998a42230123901514. Resources: {'key_pairs'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:58:17.862068 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-36bdf82e-359d-4335-a3a3-703f1c5af588 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Getting quotas for user 9315da2f7a47475dbc7f886127a8dad2 and project 1b370efdc42b4a998a42230123901514. Resources: {'key_pairs'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:58:17.866559 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-56730da1-4913-4e0c-819c-1b42a6c12195 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:17.876389 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-56730da1-4913-4e0c-819c-1b42a6c12195 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1218 microversion: 2.1 time: 0.099532 Jun 16 14:58:17.877285 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 186/379] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:17 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:17.882822 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f38ba8ed-864a-4619-8765-0d868ae281d8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:17.883424 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f38ba8ed-864a-4619-8765-0d868ae281d8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:17.889536 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f38ba8ed-864a-4619-8765-0d868ae281d8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:17.890024 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f38ba8ed-864a-4619-8765-0d868ae281d8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:17.892099 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f38ba8ed-864a-4619-8765-0d868ae281d8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:17.892828 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f38ba8ed-864a-4619-8765-0d868ae281d8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:17.893442 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-36bdf82e-359d-4335-a3a3-703f1c5af588 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055833 Jun 16 14:58:17.894297 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 194/380] 10.222.0.76 () {60 vars in 1158 bytes} [Thu Jun 16 14:58:17 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:58:18.005924 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-55db1458-a8ff-4d0f-820b-1e7c0ff7a564 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-807872943", "imageRef": "f6dfd23e-440d-4120-86bd-1cd1cb19bc0a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1123455784", "networks": [{"uuid": "6124c8b3-c13c-4537-a6a3-88a0693e8300"}]}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:18.046873 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f38ba8ed-864a-4619-8765-0d868ae281d8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:18.056312 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f38ba8ed-864a-4619-8765-0d868ae281d8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:18.057804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f38ba8ed-864a-4619-8765-0d868ae281d8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:18.057942 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.network.neutron [None req-55db1458-a8ff-4d0f-820b-1e7c0ff7a564 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] validate_networks() for [('6124c8b3-c13c-4537-a6a3-88a0693e8300', None, None, None, None, None)] {{(pid=117443) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:58:18.058987 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f38ba8ed-864a-4619-8765-0d868ae281d8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 0.180785 Jun 16 14:58:18.059539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 187/381] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:17 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:18.436739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-55db1458-a8ff-4d0f-820b-1e7c0ff7a564 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Flavor limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:58:18.437168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-55db1458-a8ff-4d0f-820b-1e7c0ff7a564 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Image limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:58:18.437629 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-55db1458-a8ff-4d0f-820b-1e7c0ff7a564 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Flavor pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:58:18.438023 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-55db1458-a8ff-4d0f-820b-1e7c0ff7a564 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Image pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:58:18.438438 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-55db1458-a8ff-4d0f-820b-1e7c0ff7a564 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:58:18.447233 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-55db1458-a8ff-4d0f-820b-1e7c0ff7a564 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:18.447670 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-55db1458-a8ff-4d0f-820b-1e7c0ff7a564 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:18.448999 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-55db1458-a8ff-4d0f-820b-1e7c0ff7a564 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:18.449145 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-55db1458-a8ff-4d0f-820b-1e7c0ff7a564 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:18.456390 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=100 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:18.467761 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-55db1458-a8ff-4d0f-820b-1e7c0ff7a564 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Getting quotas for project 1b370efdc42b4a998a42230123901514. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:58:18.471468 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-55db1458-a8ff-4d0f-820b-1e7c0ff7a564 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Getting quotas for user 9315da2f7a47475dbc7f886127a8dad2 and project 1b370efdc42b4a998a42230123901514. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:58:18.482198 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-55db1458-a8ff-4d0f-820b-1e7c0ff7a564 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Going to run 1 instances... {{(pid=117443) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:58:18.484279 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-55db1458-a8ff-4d0f-820b-1e7c0ff7a564 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6dfd23e-440d-4120-86bd-1cd1cb19bc0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:58:18.540747 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-55db1458-a8ff-4d0f-820b-1e7c0ff7a564 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538662 Jun 16 14:58:18.541412 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 195/382] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 14:58:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 14:58:18.557090 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-81c2fbfa-04aa-45e8-8e6e-a472e20f624f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:18.558033 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-81c2fbfa-04aa-45e8-8e6e-a472e20f624f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:18.579008 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-97e93eb9-b157-4303-950b-8d12b84f7373 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:18.580003 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-97e93eb9-b157-4303-950b-8d12b84f7373 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:18.591358 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-97e93eb9-b157-4303-950b-8d12b84f7373 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:18.592091 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-97e93eb9-b157-4303-950b-8d12b84f7373 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:18.595121 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-97e93eb9-b157-4303-950b-8d12b84f7373 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:18.595121 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-97e93eb9-b157-4303-950b-8d12b84f7373 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:18.627232 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-81c2fbfa-04aa-45e8-8e6e-a472e20f624f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:18.635314 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-81c2fbfa-04aa-45e8-8e6e-a472e20f624f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1258 microversion: 2.1 time: 0.086622 Jun 16 14:58:18.636040 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 188/383] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:18 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1258 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:18.642016 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-10ba2d0a-4dd5-4eba-8f68-118e26bc18fb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:18.642689 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-10ba2d0a-4dd5-4eba-8f68-118e26bc18fb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:18.650227 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10ba2d0a-4dd5-4eba-8f68-118e26bc18fb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:18.651046 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10ba2d0a-4dd5-4eba-8f68-118e26bc18fb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:18.652109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10ba2d0a-4dd5-4eba-8f68-118e26bc18fb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:18.652626 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10ba2d0a-4dd5-4eba-8f68-118e26bc18fb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:18.825884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-97e93eb9-b157-4303-950b-8d12b84f7373 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:18.834868 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-97e93eb9-b157-4303-950b-8d12b84f7373 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.261925 Jun 16 14:58:18.844205 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 196/384] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:18 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:18.860148 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-10ba2d0a-4dd5-4eba-8f68-118e26bc18fb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:18.871412 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-10ba2d0a-4dd5-4eba-8f68-118e26bc18fb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1367 microversion: 2.1 time: 0.233559 Jun 16 14:58:18.872221 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 189/385] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:18 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:18.897828 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a2075ce1-5914-4956-8ef0-ef7bcf0267be tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:18.898886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a2075ce1-5914-4956-8ef0-ef7bcf0267be tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:18.905714 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a2075ce1-5914-4956-8ef0-ef7bcf0267be tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:18.906415 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a2075ce1-5914-4956-8ef0-ef7bcf0267be tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:18.907175 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a2075ce1-5914-4956-8ef0-ef7bcf0267be tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:18.907606 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a2075ce1-5914-4956-8ef0-ef7bcf0267be tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:19.003529 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a2075ce1-5914-4956-8ef0-ef7bcf0267be tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:19.013457 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a2075ce1-5914-4956-8ef0-ef7bcf0267be tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1218 microversion: 2.1 time: 0.119439 Jun 16 14:58:19.015077 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 197/386] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:18 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:19.077412 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3ac3b9bb-2da2-421c-9aaf-eb9f7a6272de tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:19.078134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3ac3b9bb-2da2-421c-9aaf-eb9f7a6272de tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:19.084889 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3ac3b9bb-2da2-421c-9aaf-eb9f7a6272de tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:19.085338 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3ac3b9bb-2da2-421c-9aaf-eb9f7a6272de tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:19.086310 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3ac3b9bb-2da2-421c-9aaf-eb9f7a6272de tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:19.086744 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3ac3b9bb-2da2-421c-9aaf-eb9f7a6272de tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:19.091244 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=100 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:19.230316 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3ac3b9bb-2da2-421c-9aaf-eb9f7a6272de tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:19.239214 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3ac3b9bb-2da2-421c-9aaf-eb9f7a6272de tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:19.240748 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3ac3b9bb-2da2-421c-9aaf-eb9f7a6272de tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:19.241893 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3ac3b9bb-2da2-421c-9aaf-eb9f7a6272de tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 0.168639 Jun 16 14:58:19.242439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 190/387] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:19 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:19.660709 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-aceeb4af-58fb-49ad-a0d9-b255580ee62f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:19.661318 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-aceeb4af-58fb-49ad-a0d9-b255580ee62f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:19.667646 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aceeb4af-58fb-49ad-a0d9-b255580ee62f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:19.668119 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aceeb4af-58fb-49ad-a0d9-b255580ee62f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:19.668896 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aceeb4af-58fb-49ad-a0d9-b255580ee62f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:19.669345 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aceeb4af-58fb-49ad-a0d9-b255580ee62f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:19.732691 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-aceeb4af-58fb-49ad-a0d9-b255580ee62f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:19.741260 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-aceeb4af-58fb-49ad-a0d9-b255580ee62f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1262 microversion: 2.1 time: 0.084232 Jun 16 14:58:19.741625 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 198/388] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:19 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:19.851493 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b7d85b13-c529-46ff-958d-a5466a25e956 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:19.852138 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b7d85b13-c529-46ff-958d-a5466a25e956 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:19.858703 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b7d85b13-c529-46ff-958d-a5466a25e956 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:19.859156 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b7d85b13-c529-46ff-958d-a5466a25e956 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:19.859956 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b7d85b13-c529-46ff-958d-a5466a25e956 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:19.860395 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b7d85b13-c529-46ff-958d-a5466a25e956 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:19.891070 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-0ea1f5a0-83fe-4383-a01e-1273e64e5610 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:19.892517 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-0ea1f5a0-83fe-4383-a01e-1273e64e5610 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:19.903736 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0ea1f5a0-83fe-4383-a01e-1273e64e5610 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:19.903736 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0ea1f5a0-83fe-4383-a01e-1273e64e5610 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:19.904047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0ea1f5a0-83fe-4383-a01e-1273e64e5610 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:19.904262 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0ea1f5a0-83fe-4383-a01e-1273e64e5610 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:20.052040 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b7d85b13-c529-46ff-958d-a5466a25e956 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:20.062026 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b7d85b13-c529-46ff-958d-a5466a25e956 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.213902 Jun 16 14:58:20.062646 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 191/389] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:19 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:20.067417 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-88d83134-0146-447e-a09c-5185b106d8a1 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:20.068529 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-88d83134-0146-447e-a09c-5185b106d8a1 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:20.074319 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-88d83134-0146-447e-a09c-5185b106d8a1 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:20.074779 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-88d83134-0146-447e-a09c-5185b106d8a1 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:20.075565 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-88d83134-0146-447e-a09c-5185b106d8a1 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:20.076269 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-88d83134-0146-447e-a09c-5185b106d8a1 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:20.079667 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-0ea1f5a0-83fe-4383-a01e-1273e64e5610 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:20.088552 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-0ea1f5a0-83fe-4383-a01e-1273e64e5610 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1367 microversion: 2.1 time: 0.202994 Jun 16 14:58:20.089124 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 199/390] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:19 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:20.142331 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-88d83134-0146-447e-a09c-5185b106d8a1 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:20.149779 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-88d83134-0146-447e-a09c-5185b106d8a1 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1210 microversion: 2.1 time: 0.086194 Jun 16 14:58:20.150367 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 192/391] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:20 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:20.260390 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-fe710b69-92d6-49bc-837c-ecaca2a9898d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:20.260903 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-fe710b69-92d6-49bc-837c-ecaca2a9898d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:20.266956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fe710b69-92d6-49bc-837c-ecaca2a9898d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:20.267399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fe710b69-92d6-49bc-837c-ecaca2a9898d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:20.268187 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fe710b69-92d6-49bc-837c-ecaca2a9898d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:20.268615 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fe710b69-92d6-49bc-837c-ecaca2a9898d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:20.413319 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fe710b69-92d6-49bc-837c-ecaca2a9898d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:20.422284 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fe710b69-92d6-49bc-837c-ecaca2a9898d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:20.423841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fe710b69-92d6-49bc-837c-ecaca2a9898d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:20.425052 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-fe710b69-92d6-49bc-837c-ecaca2a9898d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 0.169008 Jun 16 14:58:20.425656 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 200/392] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:20 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:20.758036 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a5a0059e-93cc-4181-bb08-3d386d284cfc tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:20.758651 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a5a0059e-93cc-4181-bb08-3d386d284cfc tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:20.765128 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a5a0059e-93cc-4181-bb08-3d386d284cfc tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:20.765576 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a5a0059e-93cc-4181-bb08-3d386d284cfc tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:20.766367 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a5a0059e-93cc-4181-bb08-3d386d284cfc tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:20.766803 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a5a0059e-93cc-4181-bb08-3d386d284cfc tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:20.829838 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a5a0059e-93cc-4181-bb08-3d386d284cfc tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:20.837763 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a5a0059e-93cc-4181-bb08-3d386d284cfc tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1262 microversion: 2.1 time: 0.083591 Jun 16 14:58:20.838339 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 193/393] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:20 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:21.078851 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c1695fdd-f9e4-471b-93f9-b7ab5a752834 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:21.079450 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c1695fdd-f9e4-471b-93f9-b7ab5a752834 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:21.087138 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c1695fdd-f9e4-471b-93f9-b7ab5a752834 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:21.087583 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c1695fdd-f9e4-471b-93f9-b7ab5a752834 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:21.088380 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c1695fdd-f9e4-471b-93f9-b7ab5a752834 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:21.088813 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c1695fdd-f9e4-471b-93f9-b7ab5a752834 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:21.105818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-30e15f21-21cb-48a1-bad4-2d80c675b0ab tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:21.106413 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-30e15f21-21cb-48a1-bad4-2d80c675b0ab tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:21.113428 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-30e15f21-21cb-48a1-bad4-2d80c675b0ab tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:21.113860 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-30e15f21-21cb-48a1-bad4-2d80c675b0ab tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:21.114627 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-30e15f21-21cb-48a1-bad4-2d80c675b0ab tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:21.115061 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-30e15f21-21cb-48a1-bad4-2d80c675b0ab tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:21.282655 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c1695fdd-f9e4-471b-93f9-b7ab5a752834 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:21.290420 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c1695fdd-f9e4-471b-93f9-b7ab5a752834 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.215872 Jun 16 14:58:21.299732 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 201/394] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:21 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:21.303849 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-30e15f21-21cb-48a1-bad4-2d80c675b0ab tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:21.304433 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1a6576ff-cb66-4f1f-baf4-ad3896c21238 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:21.305032 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-1a6576ff-cb66-4f1f-baf4-ad3896c21238 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:21.312692 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-30e15f21-21cb-48a1-bad4-2d80c675b0ab tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1367 microversion: 2.1 time: 0.210656 Jun 16 14:58:21.313074 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1a6576ff-cb66-4f1f-baf4-ad3896c21238 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:21.313283 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 194/395] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:21 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:21.313524 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1a6576ff-cb66-4f1f-baf4-ad3896c21238 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:21.314294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1a6576ff-cb66-4f1f-baf4-ad3896c21238 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:21.314724 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1a6576ff-cb66-4f1f-baf4-ad3896c21238 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:21.380687 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1a6576ff-cb66-4f1f-baf4-ad3896c21238 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:21.389425 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1a6576ff-cb66-4f1f-baf4-ad3896c21238 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1210 microversion: 2.1 time: 0.088449 Jun 16 14:58:21.390674 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 202/396] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:21 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:21.444650 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c7e6f9b0-361e-41c4-a609-aee7aad7e860 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:21.445293 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c7e6f9b0-361e-41c4-a609-aee7aad7e860 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:21.451520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7e6f9b0-361e-41c4-a609-aee7aad7e860 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:21.452588 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7e6f9b0-361e-41c4-a609-aee7aad7e860 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:21.453366 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7e6f9b0-361e-41c4-a609-aee7aad7e860 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:21.453799 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7e6f9b0-361e-41c4-a609-aee7aad7e860 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:21.590050 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c7e6f9b0-361e-41c4-a609-aee7aad7e860 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:21.597988 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c7e6f9b0-361e-41c4-a609-aee7aad7e860 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:21.599508 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c7e6f9b0-361e-41c4-a609-aee7aad7e860 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:21.600662 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c7e6f9b0-361e-41c4-a609-aee7aad7e860 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 0.160405 Jun 16 14:58:21.601239 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 195/397] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:21 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:21.855357 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-0c52076b-948a-4df1-9c1f-65a20f884954 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:21.856054 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-0c52076b-948a-4df1-9c1f-65a20f884954 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:21.863580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0c52076b-948a-4df1-9c1f-65a20f884954 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:21.864039 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0c52076b-948a-4df1-9c1f-65a20f884954 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:21.864820 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0c52076b-948a-4df1-9c1f-65a20f884954 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:21.865265 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0c52076b-948a-4df1-9c1f-65a20f884954 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:21.937952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-0c52076b-948a-4df1-9c1f-65a20f884954 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:21.945724 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-0c52076b-948a-4df1-9c1f-65a20f884954 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1262 microversion: 2.1 time: 0.094124 Jun 16 14:58:21.946304 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 203/398] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:21 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:22.306466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-446d4008-eabc-480c-8d01-87d72c34e7fa tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:22.307092 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-446d4008-eabc-480c-8d01-87d72c34e7fa tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:22.314051 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-446d4008-eabc-480c-8d01-87d72c34e7fa tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:22.314501 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-446d4008-eabc-480c-8d01-87d72c34e7fa tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:22.315277 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-446d4008-eabc-480c-8d01-87d72c34e7fa tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:22.315734 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-446d4008-eabc-480c-8d01-87d72c34e7fa tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:22.330418 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7e217ee8-4f64-4124-a4ac-93d2bda0df80 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:22.331059 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7e217ee8-4f64-4124-a4ac-93d2bda0df80 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:22.337342 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e217ee8-4f64-4124-a4ac-93d2bda0df80 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:22.337820 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e217ee8-4f64-4124-a4ac-93d2bda0df80 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:22.338586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e217ee8-4f64-4124-a4ac-93d2bda0df80 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:22.339014 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e217ee8-4f64-4124-a4ac-93d2bda0df80 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:22.527851 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-446d4008-eabc-480c-8d01-87d72c34e7fa tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:22.532377 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7e217ee8-4f64-4124-a4ac-93d2bda0df80 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:22.536786 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-446d4008-eabc-480c-8d01-87d72c34e7fa tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.234159 Jun 16 14:58:22.537368 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 196/399] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:22 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:22.541364 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7e217ee8-4f64-4124-a4ac-93d2bda0df80 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1367 microversion: 2.1 time: 0.215077 Jun 16 14:58:22.542468 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6264609c-8b65-42f2-9f4e-5f626b440994 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:22.542990 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6264609c-8b65-42f2-9f4e-5f626b440994 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:22.551064 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 204/400] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:22 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:22.551711 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6264609c-8b65-42f2-9f4e-5f626b440994 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:22.552506 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6264609c-8b65-42f2-9f4e-5f626b440994 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:22.553838 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6264609c-8b65-42f2-9f4e-5f626b440994 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:22.554549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6264609c-8b65-42f2-9f4e-5f626b440994 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:22.619465 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b0e40a82-2d4a-4079-8be6-0bac05183f31 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:22.620090 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b0e40a82-2d4a-4079-8be6-0bac05183f31 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:22.627406 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b0e40a82-2d4a-4079-8be6-0bac05183f31 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:22.627888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b0e40a82-2d4a-4079-8be6-0bac05183f31 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:22.628770 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b0e40a82-2d4a-4079-8be6-0bac05183f31 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:22.629147 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b0e40a82-2d4a-4079-8be6-0bac05183f31 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:22.874858 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6264609c-8b65-42f2-9f4e-5f626b440994 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:22.884046 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6264609c-8b65-42f2-9f4e-5f626b440994 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1210 microversion: 2.1 time: 0.345377 Jun 16 14:58:22.894593 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 197/401] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:22 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1210 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:22.965142 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-65209f3b-5526-4f9a-a9f2-ce4d8ef7826e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:22.965765 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-65209f3b-5526-4f9a-a9f2-ce4d8ef7826e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:22.972126 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-65209f3b-5526-4f9a-a9f2-ce4d8ef7826e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:22.972792 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-65209f3b-5526-4f9a-a9f2-ce4d8ef7826e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:22.973730 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-65209f3b-5526-4f9a-a9f2-ce4d8ef7826e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:22.974316 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-65209f3b-5526-4f9a-a9f2-ce4d8ef7826e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:22.980312 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b0e40a82-2d4a-4079-8be6-0bac05183f31 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:23.000844 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b0e40a82-2d4a-4079-8be6-0bac05183f31 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:23.009563 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b0e40a82-2d4a-4079-8be6-0bac05183f31 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:23.012833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b0e40a82-2d4a-4079-8be6-0bac05183f31 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 0.396679 Jun 16 14:58:23.014716 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 205/402] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:22 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:58:23.066452 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-65209f3b-5526-4f9a-a9f2-ce4d8ef7826e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:23.077748 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-65209f3b-5526-4f9a-a9f2-ce4d8ef7826e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1262 microversion: 2.1 time: 0.115448 Jun 16 14:58:23.078638 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 198/403] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:22 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1262 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:23.553788 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-df2588ca-be05-49a5-8469-2c2511568414 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:23.554404 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-df2588ca-be05-49a5-8469-2c2511568414 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:23.558368 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-78febec6-087b-4d6a-90bb-29946fadc2f7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:23.559311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-78febec6-087b-4d6a-90bb-29946fadc2f7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:23.562117 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-df2588ca-be05-49a5-8469-2c2511568414 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:23.562424 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-df2588ca-be05-49a5-8469-2c2511568414 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:23.563189 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-df2588ca-be05-49a5-8469-2c2511568414 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:23.563721 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-df2588ca-be05-49a5-8469-2c2511568414 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:23.568245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-78febec6-087b-4d6a-90bb-29946fadc2f7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:23.568531 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-78febec6-087b-4d6a-90bb-29946fadc2f7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:23.569492 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-78febec6-087b-4d6a-90bb-29946fadc2f7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:23.569932 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-78febec6-087b-4d6a-90bb-29946fadc2f7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:23.778434 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-df2588ca-be05-49a5-8469-2c2511568414 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:23.789318 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-78febec6-087b-4d6a-90bb-29946fadc2f7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:23.800786 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-df2588ca-be05-49a5-8469-2c2511568414 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1502 microversion: 2.1 time: 0.250572 Jun 16 14:58:23.810569 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-78febec6-087b-4d6a-90bb-29946fadc2f7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1557 microversion: 2.1 time: 0.255687 Jun 16 14:58:23.812353 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 206/404] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:23 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1502 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:23.813457 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 199/405] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:23 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1557 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:23.829133 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d58389e3-343a-497e-b8e4-2107b6646b9c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29e3dbaa-c82f-42d3-a409-2979cb60695d"}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:23.830007 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-35777d3e-3c9a-4a92-8feb-a09e69187569 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:23.830459 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-35777d3e-3c9a-4a92-8feb-a09e69187569 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:23.832692 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d58389e3-343a-497e-b8e4-2107b6646b9c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:23.836908 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-35777d3e-3c9a-4a92-8feb-a09e69187569 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:23.837391 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-35777d3e-3c9a-4a92-8feb-a09e69187569 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:23.838175 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-35777d3e-3c9a-4a92-8feb-a09e69187569 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:23.838623 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-35777d3e-3c9a-4a92-8feb-a09e69187569 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:23.851338 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d58389e3-343a-497e-b8e4-2107b6646b9c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:23.852541 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d58389e3-343a-497e-b8e4-2107b6646b9c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:23.854398 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d58389e3-343a-497e-b8e4-2107b6646b9c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:23.855533 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d58389e3-343a-497e-b8e4-2107b6646b9c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:23.915264 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-d58389e3-343a-497e-b8e4-2107b6646b9c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] HTTP exception thrown: Cannot 'attach_volume' instance 7d2fec0d-b149-4a09-8708-1654b2d88ac0 while it is in vm_state rescued Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d58389e3-343a-497e-b8e4-2107b6646b9c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Request method failure captured: Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: POST /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0/os-volume_attachments HTTP/1.1 Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 74 Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0R1qRdeZjEhysNNbSVHXfZB1VVu39rcbyLcnNKT_HPQerPm5L0NbB6Qe3z-V5li6ayT73_iT0ECmekPXm6SH7XxZQ69z8GSRHFIOq4NpoLwssK7wDD25ZHm4AFpyW0i1-tMmc4kBrYNcVnskigrdxbzetscFHHmV1CHIkoteDHIY7M Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 2b653a9971874ddb8a49b265e3783ff3 Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-6354083 Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 14:58:23.917947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 14:58:23.919612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:58:23.919612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-ServerRescueNegativeTestJSON-6354083 Jun 16 14:58:23.919612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 2b653a9971874ddb8a49b265e3783ff3 Jun 16 14:58:23.919612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-6354083 Jun 16 14:58:23.919612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-ServerRescueNegativeTestJSON-6354083-project Jun 16 14:58:23.919612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 14:58:23.919612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 14:58:23.919612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: dc31b47df1904f9da0b5c7f370b74132 Jun 16 14:58:23.919612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-ServerRescueNegativeTestJSON-6354083-project Jun 16 14:58:23.919612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Jun 16 14:58:23.919612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {"volumeAttachment": {"volumeId": "29e3dbaa-c82f-42d3-a409-2979cb60695d"}} Jun 16 14:58:23.919612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Cannot 'attach_volume' instance 7d2fec0d-b149-4a09-8708-1654b2d88ac0 while it is in vm_state rescued Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'server_id': '7d2fec0d-b149-4a09-8708-1654b2d88ac0', 'body': {'volumeAttachment': {'volumeId': '29e3dbaa-c82f-42d3-a409-2979cb60695d'}}} Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7d2fec0d-b149-4a09-8708-1654b2d88ac0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:58:23.921022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7d2fec0d-b149-4a09-8708-1654b2d88ac0 while it is in vm_state rescued Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:58:23.922553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:58:23.924018 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:58:23.924018 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:58:23.924018 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7d2fec0d-b149-4a09-8708-1654b2d88ac0 while it is in vm_state rescued Jun 16 14:58:23.924018 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:58:23.924018 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d58389e3-343a-497e-b8e4-2107b6646b9c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Returning 409 to user: Cannot 'attach_volume' instance 7d2fec0d-b149-4a09-8708-1654b2d88ac0 while it is in vm_state rescued {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:58:23.924018 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d58389e3-343a-497e-b8e4-2107b6646b9c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "POST /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.102456 Jun 16 14:58:23.924018 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 207/406] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Jun 16 14:58:23 2022] POST /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0/os-volume_attachments => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:58:23.928288 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7f596060-6210-423b-b3e5-fa8b8f0645d3 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:23.929523 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7f596060-6210-423b-b3e5-fa8b8f0645d3 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:23.941009 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7f596060-6210-423b-b3e5-fa8b8f0645d3 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:23.941810 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7f596060-6210-423b-b3e5-fa8b8f0645d3 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:23.943021 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7f596060-6210-423b-b3e5-fa8b8f0645d3 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:23.943712 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7f596060-6210-423b-b3e5-fa8b8f0645d3 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:23.969381 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-35777d3e-3c9a-4a92-8feb-a09e69187569 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144038 Jun 16 14:58:23.970014 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 200/407] 10.222.0.76 () {58 vars in 1274 bytes} [Thu Jun 16 14:58:23 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:58:23.982888 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-188631c7-e4d6-4b45-bc8f-fa2731ab6dd0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:23.984345 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-188631c7-e4d6-4b45-bc8f-fa2731ab6dd0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:23.991133 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-188631c7-e4d6-4b45-bc8f-fa2731ab6dd0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:23.991875 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-188631c7-e4d6-4b45-bc8f-fa2731ab6dd0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:23.992984 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-188631c7-e4d6-4b45-bc8f-fa2731ab6dd0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:23.993587 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-188631c7-e4d6-4b45-bc8f-fa2731ab6dd0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:24.050605 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7f596060-6210-423b-b3e5-fa8b8f0645d3 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:24.064548 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7f596060-6210-423b-b3e5-fa8b8f0645d3 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1266 microversion: 2.1 time: 0.140418 Jun 16 14:58:24.065877 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 208/408] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:23 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:24.079509 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-188631c7-e4d6-4b45-bc8f-fa2731ab6dd0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "POST /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0/action" status: 202 len: 0 microversion: 2.1 time: 0.100941 Jun 16 14:58:24.080727 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 201/409] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Jun 16 14:58:23 2022] POST /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:58:24.083251 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6cdd65d3-1007-4325-8ac1-18faa9ad2c5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:24.084890 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6cdd65d3-1007-4325-8ac1-18faa9ad2c5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:24.093282 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-426856cd-d338-40c0-b401-ea16055a3317 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:24.093745 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6cdd65d3-1007-4325-8ac1-18faa9ad2c5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:24.094200 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6cdd65d3-1007-4325-8ac1-18faa9ad2c5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:24.094389 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-426856cd-d338-40c0-b401-ea16055a3317 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:24.094975 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6cdd65d3-1007-4325-8ac1-18faa9ad2c5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:24.095405 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6cdd65d3-1007-4325-8ac1-18faa9ad2c5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:24.105512 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-426856cd-d338-40c0-b401-ea16055a3317 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:24.106305 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-426856cd-d338-40c0-b401-ea16055a3317 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:24.107337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-426856cd-d338-40c0-b401-ea16055a3317 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:24.108471 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-426856cd-d338-40c0-b401-ea16055a3317 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:24.349638 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-426856cd-d338-40c0-b401-ea16055a3317 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:24.365813 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-426856cd-d338-40c0-b401-ea16055a3317 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1510 microversion: 2.1 time: 0.279355 Jun 16 14:58:24.380491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 202/410] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:24 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:24.389444 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b7f2cfc0-a3cf-4a32-adb0-294152af7c2d tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:24.389444 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b7f2cfc0-a3cf-4a32-adb0-294152af7c2d tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:24.394043 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6cdd65d3-1007-4325-8ac1-18faa9ad2c5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:24.405456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b7f2cfc0-a3cf-4a32-adb0-294152af7c2d tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:24.406037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b7f2cfc0-a3cf-4a32-adb0-294152af7c2d tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:24.406814 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6cdd65d3-1007-4325-8ac1-18faa9ad2c5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:24.407442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b7f2cfc0-a3cf-4a32-adb0-294152af7c2d tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:24.408035 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b7f2cfc0-a3cf-4a32-adb0-294152af7c2d tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:24.408361 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6cdd65d3-1007-4325-8ac1-18faa9ad2c5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:24.409538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6cdd65d3-1007-4325-8ac1-18faa9ad2c5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1745 microversion: 2.20 time: 0.332586 Jun 16 14:58:24.410084 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 209/411] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:24 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1745 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:24.516967 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b7f2cfc0-a3cf-4a32-adb0-294152af7c2d tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:24.530408 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b7f2cfc0-a3cf-4a32-adb0-294152af7c2d tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1310 microversion: 2.1 time: 0.147986 Jun 16 14:58:24.531002 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 203/412] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:24 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1310 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:25.089816 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4be6c35a-41f8-4ec9-bc86-f7fac11b966a tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:25.091293 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4be6c35a-41f8-4ec9-bc86-f7fac11b966a tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:25.105937 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4be6c35a-41f8-4ec9-bc86-f7fac11b966a tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:25.106667 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4be6c35a-41f8-4ec9-bc86-f7fac11b966a tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:25.107444 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4be6c35a-41f8-4ec9-bc86-f7fac11b966a tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:25.109146 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4be6c35a-41f8-4ec9-bc86-f7fac11b966a tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:25.227922 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4be6c35a-41f8-4ec9-bc86-f7fac11b966a tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:25.238967 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4be6c35a-41f8-4ec9-bc86-f7fac11b966a tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1266 microversion: 2.1 time: 0.152379 Jun 16 14:58:25.249558 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 210/413] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:25 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:25.389620 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-13ffb0e5-6e8b-4127-aa56-3975b571b34e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:25.390243 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-13ffb0e5-6e8b-4127-aa56-3975b571b34e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:25.405747 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-13ffb0e5-6e8b-4127-aa56-3975b571b34e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:25.406458 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-13ffb0e5-6e8b-4127-aa56-3975b571b34e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:25.407251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-13ffb0e5-6e8b-4127-aa56-3975b571b34e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:25.407685 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-13ffb0e5-6e8b-4127-aa56-3975b571b34e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:25.429261 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ecebc31b-1f1f-4771-83af-b1279f4d7a29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:25.430167 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ecebc31b-1f1f-4771-83af-b1279f4d7a29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:25.462283 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ecebc31b-1f1f-4771-83af-b1279f4d7a29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:25.465910 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ecebc31b-1f1f-4771-83af-b1279f4d7a29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:25.469781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ecebc31b-1f1f-4771-83af-b1279f4d7a29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:25.472681 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ecebc31b-1f1f-4771-83af-b1279f4d7a29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:26.164903 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-13ffb0e5-6e8b-4127-aa56-3975b571b34e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:26.182020 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-13ffb0e5-6e8b-4127-aa56-3975b571b34e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1510 microversion: 2.1 time: 0.798123 Jun 16 14:58:26.185504 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 204/414] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:25 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1510 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:26.207651 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-033d9f34-c89d-4423-9515-39c2389370f6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:26.208303 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-033d9f34-c89d-4423-9515-39c2389370f6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:26.221032 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-033d9f34-c89d-4423-9515-39c2389370f6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:26.221654 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-033d9f34-c89d-4423-9515-39c2389370f6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:26.223618 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-033d9f34-c89d-4423-9515-39c2389370f6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:26.223618 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-033d9f34-c89d-4423-9515-39c2389370f6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:26.279951 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ecebc31b-1f1f-4771-83af-b1279f4d7a29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:26.293405 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ecebc31b-1f1f-4771-83af-b1279f4d7a29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:26.298726 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ecebc31b-1f1f-4771-83af-b1279f4d7a29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:26.301167 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ecebc31b-1f1f-4771-83af-b1279f4d7a29 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1745 microversion: 2.20 time: 0.876654 Jun 16 14:58:26.304883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 211/415] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:25 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1745 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:26.320174 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a2f345cb-7f7e-42db-a39e-b24ec1b69be0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:26.320999 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a2f345cb-7f7e-42db-a39e-b24ec1b69be0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:26.329824 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a2f345cb-7f7e-42db-a39e-b24ec1b69be0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:26.331026 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a2f345cb-7f7e-42db-a39e-b24ec1b69be0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:26.332019 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a2f345cb-7f7e-42db-a39e-b24ec1b69be0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:26.332605 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a2f345cb-7f7e-42db-a39e-b24ec1b69be0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:26.395030 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-033d9f34-c89d-4423-9515-39c2389370f6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:26.408471 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-033d9f34-c89d-4423-9515-39c2389370f6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1316 microversion: 2.1 time: 0.220549 Jun 16 14:58:26.410488 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 205/416] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:26 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:26.417358 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-6cde238a-0b21-4cd9-bf7e-9f5ab83d06fe req-66c73e96-93eb-4822-97d9-252c897dcd8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36bbbe9f-1cae-453f-9d25-38654f3e30a8", "tag": "b960162a-2e73-4c2d-9e31-9b643f7e6471"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:26.435799 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-6cde238a-0b21-4cd9-bf7e-9f5ab83d06fe req-66c73e96-93eb-4822-97d9-252c897dcd8b service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:26.437511 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-6cde238a-0b21-4cd9-bf7e-9f5ab83d06fe req-66c73e96-93eb-4822-97d9-252c897dcd8b service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:26.453368 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a2f345cb-7f7e-42db-a39e-b24ec1b69be0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:26.472443 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=100 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:26.475242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a2f345cb-7f7e-42db-a39e-b24ec1b69be0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1272 microversion: 2.1 time: 0.168721 Jun 16 14:58:26.480721 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 212/417] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:26 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:26.481430 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:26.484353 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-6cde238a-0b21-4cd9-bf7e-9f5ab83d06fe req-66c73e96-93eb-4822-97d9-252c897dcd8b service nova] Creating event network-changed:b960162a-2e73-4c2d-9e31-9b643f7e6471 for instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 on hv-cinder-83716 Jun 16 14:58:26.491184 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-6cde238a-0b21-4cd9-bf7e-9f5ab83d06fe req-66c73e96-93eb-4822-97d9-252c897dcd8b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078946 Jun 16 14:58:26.492104 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 206/418] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:58:27.009987 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d4a1b9be-b942-4b28-9c17-10c6e20f81bd tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:27.010495 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d4a1b9be-b942-4b28-9c17-10c6e20f81bd tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:27.026811 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d4a1b9be-b942-4b28-9c17-10c6e20f81bd tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:27.027603 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d4a1b9be-b942-4b28-9c17-10c6e20f81bd tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:27.040037 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d4a1b9be-b942-4b28-9c17-10c6e20f81bd tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:27.041110 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d4a1b9be-b942-4b28-9c17-10c6e20f81bd tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:27.205873 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-adb764b2-7d6c-4dda-8bd9-81f4bc69c5f3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:27.206656 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-adb764b2-7d6c-4dda-8bd9-81f4bc69c5f3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:27.222849 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-adb764b2-7d6c-4dda-8bd9-81f4bc69c5f3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:27.223562 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-adb764b2-7d6c-4dda-8bd9-81f4bc69c5f3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:27.235074 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-adb764b2-7d6c-4dda-8bd9-81f4bc69c5f3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:27.235707 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-adb764b2-7d6c-4dda-8bd9-81f4bc69c5f3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:27.453335 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.objects.instance [None req-d4a1b9be-b942-4b28-9c17-10c6e20f81bd tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lazy-loading 'services' on Instance uuid 34f1cea3-93d7-4092-9cf2-814af9af3984 {{(pid=117443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:58:27.705268 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d4a1b9be-b942-4b28-9c17-10c6e20f81bd tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "DELETE /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984/os-volume_attachments/0837cdf7-b7ff-4859-8dcf-2a8ebf3c5b13" status: 202 len: 0 microversion: 2.1 time: 0.702725 Jun 16 14:58:27.712669 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 213/419] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Jun 16 14:58:27 2022] DELETE /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984/os-volume_attachments/0837cdf7-b7ff-4859-8dcf-2a8ebf3c5b13 => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:58:27.746968 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-df0c7552-a564-4894-a3d2-e426e2b0eb76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:27.756766 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-df0c7552-a564-4894-a3d2-e426e2b0eb76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:27.791133 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-df0c7552-a564-4894-a3d2-e426e2b0eb76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:27.793966 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-df0c7552-a564-4894-a3d2-e426e2b0eb76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:27.796506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-df0c7552-a564-4894-a3d2-e426e2b0eb76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:27.798301 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-df0c7552-a564-4894-a3d2-e426e2b0eb76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:28.456124 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=4 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:28.478216 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=16 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:28.632145 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=4 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:28.843285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-df0c7552-a564-4894-a3d2-e426e2b0eb76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:28.853434 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-df0c7552-a564-4894-a3d2-e426e2b0eb76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:28.865555 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-df0c7552-a564-4894-a3d2-e426e2b0eb76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:28.872266 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-df0c7552-a564-4894-a3d2-e426e2b0eb76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1745 microversion: 2.20 time: 1.157590 Jun 16 14:58:28.882202 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 214/420] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:27 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1745 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:28.887591 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6e3f2874-aa27-4426-8ee6-7f3f84f594f8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:28.895229 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6e3f2874-aa27-4426-8ee6-7f3f84f594f8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:28.923492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6e3f2874-aa27-4426-8ee6-7f3f84f594f8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:28.935365 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6e3f2874-aa27-4426-8ee6-7f3f84f594f8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:28.937937 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6e3f2874-aa27-4426-8ee6-7f3f84f594f8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:28.945731 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6e3f2874-aa27-4426-8ee6-7f3f84f594f8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:29.304621 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-adb764b2-7d6c-4dda-8bd9-81f4bc69c5f3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:29.319983 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-adb764b2-7d6c-4dda-8bd9-81f4bc69c5f3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1510 microversion: 2.1 time: 2.120942 Jun 16 14:58:29.325347 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 207/421] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:27 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1510 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:29.349085 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f789dd2e-04cd-4e8a-a761-f823c41b4c4c tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:29.353479 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f789dd2e-04cd-4e8a-a761-f823c41b4c4c tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:29.379853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f789dd2e-04cd-4e8a-a761-f823c41b4c4c tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:29.386183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f789dd2e-04cd-4e8a-a761-f823c41b4c4c tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:29.390163 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f789dd2e-04cd-4e8a-a761-f823c41b4c4c tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:29.392136 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f789dd2e-04cd-4e8a-a761-f823c41b4c4c tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:29.612661 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6e3f2874-aa27-4426-8ee6-7f3f84f594f8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:29.620876 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f789dd2e-04cd-4e8a-a761-f823c41b4c4c tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:29.633316 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6e3f2874-aa27-4426-8ee6-7f3f84f594f8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 0.749536 Jun 16 14:58:29.636926 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 215/422] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:28 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:29.654277 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f789dd2e-04cd-4e8a-a761-f823c41b4c4c tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1272 microversion: 2.1 time: 0.325178 Jun 16 14:58:29.660335 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 208/423] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:29 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1272 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:29.682864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-a5c970a1-d53f-4abb-9e44-03dac7c0f149 req-7b4668c9-8336-49c5-a46f-6b170abcd61b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663488be-459f-4a58-aa1c-82be04813a2f", "name": "network-vif-plugged", "status": "completed", "tag": "5508bdf2-993b-44f0-8926-4159b1e31b1d"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:29.713767 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-a5c970a1-d53f-4abb-9e44-03dac7c0f149 req-7b4668c9-8336-49c5-a46f-6b170abcd61b service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:29.714683 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-a5c970a1-d53f-4abb-9e44-03dac7c0f149 req-7b4668c9-8336-49c5-a46f-6b170abcd61b service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:29.736535 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-a5c970a1-d53f-4abb-9e44-03dac7c0f149 req-7b4668c9-8336-49c5-a46f-6b170abcd61b service nova] Creating event network-vif-plugged:5508bdf2-993b-44f0-8926-4159b1e31b1d for instance 663488be-459f-4a58-aa1c-82be04813a2f on hv-cinder-83716 Jun 16 14:58:29.742189 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-a5c970a1-d53f-4abb-9e44-03dac7c0f149 req-7b4668c9-8336-49c5-a46f-6b170abcd61b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103228 Jun 16 14:58:29.743395 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 216/424] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:58:29.898958 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f9ead345-1b0d-4b47-9981-01ed781e7c2e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:29.900147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f9ead345-1b0d-4b47-9981-01ed781e7c2e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:29.908266 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f9ead345-1b0d-4b47-9981-01ed781e7c2e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:29.908995 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f9ead345-1b0d-4b47-9981-01ed781e7c2e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:29.910301 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f9ead345-1b0d-4b47-9981-01ed781e7c2e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:29.910748 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f9ead345-1b0d-4b47-9981-01ed781e7c2e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:30.144399 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f9ead345-1b0d-4b47-9981-01ed781e7c2e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:30.158319 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f9ead345-1b0d-4b47-9981-01ed781e7c2e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:30.159898 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f9ead345-1b0d-4b47-9981-01ed781e7c2e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:30.161788 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f9ead345-1b0d-4b47-9981-01ed781e7c2e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.266829 Jun 16 14:58:30.162608 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 209/425] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:29 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:30.349587 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b08415ba-6f2a-4549-ac4d-f26a6e641123 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:30.350291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b08415ba-6f2a-4549-ac4d-f26a6e641123 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:30.357787 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b08415ba-6f2a-4549-ac4d-f26a6e641123 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:30.359177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b08415ba-6f2a-4549-ac4d-f26a6e641123 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:30.360147 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b08415ba-6f2a-4549-ac4d-f26a6e641123 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:30.360733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b08415ba-6f2a-4549-ac4d-f26a6e641123 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:30.550536 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b08415ba-6f2a-4549-ac4d-f26a6e641123 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:30.558908 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b08415ba-6f2a-4549-ac4d-f26a6e641123 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1510 microversion: 2.1 time: 0.213447 Jun 16 14:58:30.559497 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 217/426] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:30 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1510 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:30.654812 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-64f139ba-d384-444d-b692-269efeaeecdf tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:30.657273 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-64f139ba-d384-444d-b692-269efeaeecdf tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:30.673513 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-64f139ba-d384-444d-b692-269efeaeecdf tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:30.684893 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c3d1ff1d-3a16-4ab8-a088-38a96d58a130 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:30.685846 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c3d1ff1d-3a16-4ab8-a088-38a96d58a130 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:30.692109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-64f139ba-d384-444d-b692-269efeaeecdf tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:30.697511 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-64f139ba-d384-444d-b692-269efeaeecdf tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:30.700626 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-64f139ba-d384-444d-b692-269efeaeecdf tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:30.704381 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c3d1ff1d-3a16-4ab8-a088-38a96d58a130 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:30.716330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c3d1ff1d-3a16-4ab8-a088-38a96d58a130 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:30.721983 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c3d1ff1d-3a16-4ab8-a088-38a96d58a130 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:30.722739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c3d1ff1d-3a16-4ab8-a088-38a96d58a130 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:30.999578 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c3d1ff1d-3a16-4ab8-a088-38a96d58a130 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:31.012051 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c3d1ff1d-3a16-4ab8-a088-38a96d58a130 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1314 microversion: 2.1 time: 0.333503 Jun 16 14:58:31.016676 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 218/427] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:30 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:31.038606 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-64f139ba-d384-444d-b692-269efeaeecdf tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:31.049515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-64f139ba-d384-444d-b692-269efeaeecdf tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 0.399384 Jun 16 14:58:31.062786 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 210/428] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:30 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:31.183452 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d36ad967-6e42-49bf-8381-992de016eeec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:31.184485 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d36ad967-6e42-49bf-8381-992de016eeec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:31.190069 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:31.197909 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d36ad967-6e42-49bf-8381-992de016eeec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:31.199042 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d36ad967-6e42-49bf-8381-992de016eeec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:31.200455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d36ad967-6e42-49bf-8381-992de016eeec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:31.201163 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d36ad967-6e42-49bf-8381-992de016eeec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:31.516339 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d36ad967-6e42-49bf-8381-992de016eeec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:31.530783 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d36ad967-6e42-49bf-8381-992de016eeec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:31.532791 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d36ad967-6e42-49bf-8381-992de016eeec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:31.536763 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d36ad967-6e42-49bf-8381-992de016eeec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.356470 Jun 16 14:58:31.537711 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 219/429] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:31 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:31.579830 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-127794f0-39e8-402c-a385-b95bd2ce454e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:31.586835 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-127794f0-39e8-402c-a385-b95bd2ce454e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:31.613983 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-127794f0-39e8-402c-a385-b95bd2ce454e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:31.625039 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-127794f0-39e8-402c-a385-b95bd2ce454e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:31.632401 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-127794f0-39e8-402c-a385-b95bd2ce454e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:31.633672 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-127794f0-39e8-402c-a385-b95bd2ce454e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:31.846060 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-127794f0-39e8-402c-a385-b95bd2ce454e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:31.857779 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-127794f0-39e8-402c-a385-b95bd2ce454e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1510 microversion: 2.1 time: 0.283167 Jun 16 14:58:31.859123 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 211/430] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:31 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1510 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:32.036473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-233c1c16-e349-44af-a659-2b6c235b4f2e tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:32.038050 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-233c1c16-e349-44af-a659-2b6c235b4f2e tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:32.052883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-233c1c16-e349-44af-a659-2b6c235b4f2e tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:32.053411 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-233c1c16-e349-44af-a659-2b6c235b4f2e tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:32.054218 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-233c1c16-e349-44af-a659-2b6c235b4f2e tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:32.061460 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-233c1c16-e349-44af-a659-2b6c235b4f2e tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:32.072614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a0f5ff8f-509f-4665-a0e1-66299e7859e9 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:32.073759 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a0f5ff8f-509f-4665-a0e1-66299e7859e9 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:32.088952 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a0f5ff8f-509f-4665-a0e1-66299e7859e9 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:32.091430 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a0f5ff8f-509f-4665-a0e1-66299e7859e9 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:32.093994 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a0f5ff8f-509f-4665-a0e1-66299e7859e9 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:32.095151 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a0f5ff8f-509f-4665-a0e1-66299e7859e9 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:32.324809 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-233c1c16-e349-44af-a659-2b6c235b4f2e tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:32.353538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-233c1c16-e349-44af-a659-2b6c235b4f2e tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1314 microversion: 2.1 time: 0.320809 Jun 16 14:58:32.369619 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 220/431] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:32 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:32.494727 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a0f5ff8f-509f-4665-a0e1-66299e7859e9 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:32.507242 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a0f5ff8f-509f-4665-a0e1-66299e7859e9 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 0.441245 Jun 16 14:58:32.508272 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 212/432] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:32 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:32.569217 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-9be2d297-1fc3-4aa9-9fe5-6396e9a02b42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:32.570725 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-9be2d297-1fc3-4aa9-9fe5-6396e9a02b42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:32.582296 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9be2d297-1fc3-4aa9-9fe5-6396e9a02b42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:32.583429 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9be2d297-1fc3-4aa9-9fe5-6396e9a02b42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:32.584826 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9be2d297-1fc3-4aa9-9fe5-6396e9a02b42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:32.585818 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9be2d297-1fc3-4aa9-9fe5-6396e9a02b42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:32.856489 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-9be2d297-1fc3-4aa9-9fe5-6396e9a02b42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:32.866520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-9be2d297-1fc3-4aa9-9fe5-6396e9a02b42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:32.868634 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-9be2d297-1fc3-4aa9-9fe5-6396e9a02b42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:32.870823 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-9be2d297-1fc3-4aa9-9fe5-6396e9a02b42 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.308886 Jun 16 14:58:32.878812 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8b3e3ea0-78a2-4d39-aa71-60ecd20a48a9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:32.880433 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8b3e3ea0-78a2-4d39-aa71-60ecd20a48a9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:32.883191 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 221/433] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:32 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:32.891418 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8b3e3ea0-78a2-4d39-aa71-60ecd20a48a9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:32.892446 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8b3e3ea0-78a2-4d39-aa71-60ecd20a48a9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:32.893796 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8b3e3ea0-78a2-4d39-aa71-60ecd20a48a9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:32.894240 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8b3e3ea0-78a2-4d39-aa71-60ecd20a48a9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:33.379051 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a397a57b-b8c0-4485-8505-33f7ff274dd1 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:33.380992 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a397a57b-b8c0-4485-8505-33f7ff274dd1 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:33.416278 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a397a57b-b8c0-4485-8505-33f7ff274dd1 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:33.420977 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a397a57b-b8c0-4485-8505-33f7ff274dd1 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:33.422906 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a397a57b-b8c0-4485-8505-33f7ff274dd1 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:33.425105 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a397a57b-b8c0-4485-8505-33f7ff274dd1 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:33.438569 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8b3e3ea0-78a2-4d39-aa71-60ecd20a48a9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:33.449305 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8b3e3ea0-78a2-4d39-aa71-60ecd20a48a9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1510 microversion: 2.1 time: 0.575160 Jun 16 14:58:33.449872 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 213/434] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:32 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1510 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:33.525408 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ac0ec73a-50a2-47a9-9d74-e8435faf6c5e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:33.526323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ac0ec73a-50a2-47a9-9d74-e8435faf6c5e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:33.538422 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ac0ec73a-50a2-47a9-9d74-e8435faf6c5e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:33.540502 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ac0ec73a-50a2-47a9-9d74-e8435faf6c5e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:33.542288 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ac0ec73a-50a2-47a9-9d74-e8435faf6c5e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:33.543971 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ac0ec73a-50a2-47a9-9d74-e8435faf6c5e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:33.821788 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a397a57b-b8c0-4485-8505-33f7ff274dd1 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:33.844222 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a397a57b-b8c0-4485-8505-33f7ff274dd1 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1314 microversion: 2.1 time: 0.473474 Jun 16 14:58:33.847102 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 222/435] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:33 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:33.918254 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d3ef1853-da81-454a-8895-65d029b56ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:33.924028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d3ef1853-da81-454a-8895-65d029b56ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:33.945429 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d3ef1853-da81-454a-8895-65d029b56ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:33.946073 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d3ef1853-da81-454a-8895-65d029b56ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:33.947018 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d3ef1853-da81-454a-8895-65d029b56ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:33.948276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d3ef1853-da81-454a-8895-65d029b56ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:34.089549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ac0ec73a-50a2-47a9-9d74-e8435faf6c5e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:34.100637 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ac0ec73a-50a2-47a9-9d74-e8435faf6c5e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 0.579369 Jun 16 14:58:34.116938 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 214/436] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:33 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:34.468630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-69efbf82-2520-4c0c-a4ae-e0c3d68b4cec tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:34.469748 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-69efbf82-2520-4c0c-a4ae-e0c3d68b4cec tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:34.472012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=100 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:34.485873 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-69efbf82-2520-4c0c-a4ae-e0c3d68b4cec tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:34.488981 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-69efbf82-2520-4c0c-a4ae-e0c3d68b4cec tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:34.490087 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-69efbf82-2520-4c0c-a4ae-e0c3d68b4cec tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:34.491469 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-69efbf82-2520-4c0c-a4ae-e0c3d68b4cec tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:34.700131 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d3ef1853-da81-454a-8895-65d029b56ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:34.711738 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d3ef1853-da81-454a-8895-65d029b56ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:34.720930 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d3ef1853-da81-454a-8895-65d029b56ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:34.724740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d3ef1853-da81-454a-8895-65d029b56ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.838037 Jun 16 14:58:34.725999 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 223/437] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:33 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:34.749071 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f8863133-5222-4c85-8e33-f2c244cb9682 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:34.764586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f8863133-5222-4c85-8e33-f2c244cb9682 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:34.778938 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f8863133-5222-4c85-8e33-f2c244cb9682 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:34.780254 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f8863133-5222-4c85-8e33-f2c244cb9682 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:34.781462 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f8863133-5222-4c85-8e33-f2c244cb9682 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:34.786421 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f8863133-5222-4c85-8e33-f2c244cb9682 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:34.889808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f8863133-5222-4c85-8e33-f2c244cb9682 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Going to try to terminate instance {{(pid=117443) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:58:35.091171 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f8863133-5222-4c85-8e33-f2c244cb9682 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "DELETE /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 204 len: 0 microversion: 2.1 time: 0.359595 Jun 16 14:58:35.092229 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 224/438] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 14:58:34 2022] DELETE /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:58:35.097401 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-560fdb7b-5ce9-4971-9afa-ed01ef8a1919 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:35.098931 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-560fdb7b-5ce9-4971-9afa-ed01ef8a1919 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:35.121492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-560fdb7b-5ce9-4971-9afa-ed01ef8a1919 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:35.122131 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-560fdb7b-5ce9-4971-9afa-ed01ef8a1919 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:35.123260 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-560fdb7b-5ce9-4971-9afa-ed01ef8a1919 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:35.126605 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-560fdb7b-5ce9-4971-9afa-ed01ef8a1919 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:35.411920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-560fdb7b-5ce9-4971-9afa-ed01ef8a1919 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:35.526657 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-560fdb7b-5ce9-4971-9afa-ed01ef8a1919 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1314 microversion: 2.1 time: 0.427093 Jun 16 14:58:35.548678 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 225/439] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:35 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:35.616801 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-be64738b-6758-4256-8ae1-422acaa69bd1 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:35.618830 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-be64738b-6758-4256-8ae1-422acaa69bd1 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:35.643425 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-be64738b-6758-4256-8ae1-422acaa69bd1 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:35.644699 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-be64738b-6758-4256-8ae1-422acaa69bd1 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:35.649859 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-be64738b-6758-4256-8ae1-422acaa69bd1 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:35.651613 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-be64738b-6758-4256-8ae1-422acaa69bd1 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:35.674285 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-69efbf82-2520-4c0c-a4ae-e0c3d68b4cec tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:35.711143 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-69efbf82-2520-4c0c-a4ae-e0c3d68b4cec tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1516 microversion: 2.1 time: 1.246231 Jun 16 14:58:35.730254 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 215/440] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:34 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1516 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:35.785619 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-50041254-5ce0-4dce-aac1-2f24a9a5f772 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:35.786575 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-50041254-5ce0-4dce-aac1-2f24a9a5f772 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:35.817752 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-50041254-5ce0-4dce-aac1-2f24a9a5f772 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:35.819011 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-50041254-5ce0-4dce-aac1-2f24a9a5f772 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:35.821986 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-50041254-5ce0-4dce-aac1-2f24a9a5f772 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:35.824784 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-50041254-5ce0-4dce-aac1-2f24a9a5f772 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:36.543722 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-be64738b-6758-4256-8ae1-422acaa69bd1 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:36.563821 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-be64738b-6758-4256-8ae1-422acaa69bd1 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1512 microversion: 2.1 time: 1.012462 Jun 16 14:58:36.566967 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 226/441] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:35 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1512 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:36.577274 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-304dd5c5-da62-4e68-8729-e24157d0af19 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:36.578721 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-304dd5c5-da62-4e68-8729-e24157d0af19 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:36.593966 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-304dd5c5-da62-4e68-8729-e24157d0af19 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:36.595249 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-304dd5c5-da62-4e68-8729-e24157d0af19 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:36.596987 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-304dd5c5-da62-4e68-8729-e24157d0af19 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:36.597964 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-304dd5c5-da62-4e68-8729-e24157d0af19 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:37.154910 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-50041254-5ce0-4dce-aac1-2f24a9a5f772 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:37.190113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-50041254-5ce0-4dce-aac1-2f24a9a5f772 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 1.457528 Jun 16 14:58:37.200931 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 216/442] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:35 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:37.244848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-10cc9091-d2c6-4bec-8dbd-1f8e1fa6a89d tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:37.245256 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-304dd5c5-da62-4e68-8729-e24157d0af19 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:37.245474 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-10cc9091-d2c6-4bec-8dbd-1f8e1fa6a89d tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:37.262775 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:37.273401 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10cc9091-d2c6-4bec-8dbd-1f8e1fa6a89d tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:37.278004 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10cc9091-d2c6-4bec-8dbd-1f8e1fa6a89d tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:37.284509 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-304dd5c5-da62-4e68-8729-e24157d0af19 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:37.285278 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10cc9091-d2c6-4bec-8dbd-1f8e1fa6a89d tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:37.286196 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10cc9091-d2c6-4bec-8dbd-1f8e1fa6a89d tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:37.288833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-304dd5c5-da62-4e68-8729-e24157d0af19 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:37.290976 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-304dd5c5-da62-4e68-8729-e24157d0af19 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.721819 Jun 16 14:58:37.292026 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 227/443] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:36 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:37.538946 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f63e25f5-0d36-46d1-9d0c-2f2a6091cc5e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Action: 'create', calling method: .version_select at 0x7f33e14b3310>, body: {"keypair": {"name": "tempest-keypair-2102761029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxOomlr7xDyTp/jaGf4/ZFHvVVRH5UbdDZJflBbVTFVn/E7U8wK012M57ICHo53mXnXbJvymLWyP84zBHwOU4Mlg3GwFBzRSLyQz3LXXBnOtv0lEsajK02QNHS6dLyfQA=="}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:37.570187 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-f63e25f5-0d36-46d1-9d0c-2f2a6091cc5e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Getting quotas for project 2b653a9971874ddb8a49b265e3783ff3. Resources: {'key_pairs'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:58:37.576647 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-f63e25f5-0d36-46d1-9d0c-2f2a6091cc5e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Getting quotas for user dc31b47df1904f9da0b5c7f370b74132 and project 2b653a9971874ddb8a49b265e3783ff3. Resources: {'key_pairs'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:58:37.625949 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f63e25f5-0d36-46d1-9d0c-2f2a6091cc5e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.093000 Jun 16 14:58:37.627462 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 228/444] 10.222.0.76 () {60 vars in 1158 bytes} [Thu Jun 16 14:58:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:58:37.649822 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d4b9059a-3722-441d-8b08-98fa338685b7 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:37.653088 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d4b9059a-3722-441d-8b08-98fa338685b7 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:37.694859 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d4b9059a-3722-441d-8b08-98fa338685b7 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:37.697566 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d4b9059a-3722-441d-8b08-98fa338685b7 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:37.705967 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d4b9059a-3722-441d-8b08-98fa338685b7 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:37.707564 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d4b9059a-3722-441d-8b08-98fa338685b7 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:38.084938 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-10cc9091-d2c6-4bec-8dbd-1f8e1fa6a89d tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:38.140674 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-10cc9091-d2c6-4bec-8dbd-1f8e1fa6a89d tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1314 microversion: 2.1 time: 0.947510 Jun 16 14:58:38.148433 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 217/445] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:37 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1314 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:38.179309 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-ce07f424-65b6-426f-961a-e55e08cac641 req-6f842fa5-0b43-4af7-93be-fc9b2880eb76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57ad15bd-b09a-4896-97fd-86b4dc5cdab0", "tag": "fad8a98c-0e41-4630-8105-a78c2c1e11d8"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:38.208286 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-ce07f424-65b6-426f-961a-e55e08cac641 req-6f842fa5-0b43-4af7-93be-fc9b2880eb76 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:38.211191 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-ce07f424-65b6-426f-961a-e55e08cac641 req-6f842fa5-0b43-4af7-93be-fc9b2880eb76 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:38.293638 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-ce07f424-65b6-426f-961a-e55e08cac641 req-6f842fa5-0b43-4af7-93be-fc9b2880eb76 service nova] Creating event network-changed:fad8a98c-0e41-4630-8105-a78c2c1e11d8 for instance 57ad15bd-b09a-4896-97fd-86b4dc5cdab0 on hv-cinder-83716 Jun 16 14:58:38.327633 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-ce07f424-65b6-426f-961a-e55e08cac641 req-6f842fa5-0b43-4af7-93be-fc9b2880eb76 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172453 Jun 16 14:58:38.341462 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 218/446] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:58:38.354007 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-72a79572-d5b2-4cf1-a68b-244316bcf3d7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:38.356898 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-72a79572-d5b2-4cf1-a68b-244316bcf3d7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:38.412571 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-72a79572-d5b2-4cf1-a68b-244316bcf3d7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:38.416000 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-72a79572-d5b2-4cf1-a68b-244316bcf3d7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:38.428314 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-72a79572-d5b2-4cf1-a68b-244316bcf3d7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:38.432809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-72a79572-d5b2-4cf1-a68b-244316bcf3d7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:38.744008 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d4b9059a-3722-441d-8b08-98fa338685b7 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:38.769094 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d4b9059a-3722-441d-8b08-98fa338685b7 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1512 microversion: 2.1 time: 1.136879 Jun 16 14:58:38.770307 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 229/447] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:37 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1512 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:38.778293 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3b5a9d12-974f-4142-b8ea-08797b760a77 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:38.779239 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-3b5a9d12-974f-4142-b8ea-08797b760a77 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:38.797299 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3b5a9d12-974f-4142-b8ea-08797b760a77 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:38.798220 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3b5a9d12-974f-4142-b8ea-08797b760a77 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:38.799276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3b5a9d12-974f-4142-b8ea-08797b760a77 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:38.800141 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3b5a9d12-974f-4142-b8ea-08797b760a77 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:39.621756 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3b5a9d12-974f-4142-b8ea-08797b760a77 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:39.632864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3b5a9d12-974f-4142-b8ea-08797b760a77 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:39.640264 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3b5a9d12-974f-4142-b8ea-08797b760a77 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:39.650393 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3b5a9d12-974f-4142-b8ea-08797b760a77 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.878363 Jun 16 14:58:39.651937 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 230/448] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:38 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:39.682294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8c52276d-542a-4e28-a0ee-8f978b451f18 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:39.686566 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-8c52276d-542a-4e28-a0ee-8f978b451f18 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:39.708557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c52276d-542a-4e28-a0ee-8f978b451f18 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:39.709697 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c52276d-542a-4e28-a0ee-8f978b451f18 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:39.711227 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c52276d-542a-4e28-a0ee-8f978b451f18 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:39.712036 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c52276d-542a-4e28-a0ee-8f978b451f18 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:40.081198 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-72a79572-d5b2-4cf1-a68b-244316bcf3d7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:40.098089 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-72a79572-d5b2-4cf1-a68b-244316bcf3d7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 1.754008 Jun 16 14:58:40.104871 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 219/449] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:38 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:40.117608 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1b2a2814-b0e3-4c5a-8919-2cedc3a830de tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:40.127398 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1b2a2814-b0e3-4c5a-8919-2cedc3a830de tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:40.135105 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1b2a2814-b0e3-4c5a-8919-2cedc3a830de tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:40.135936 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1b2a2814-b0e3-4c5a-8919-2cedc3a830de tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:40.136915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1b2a2814-b0e3-4c5a-8919-2cedc3a830de tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:40.141072 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1b2a2814-b0e3-4c5a-8919-2cedc3a830de tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:40.207895 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1b2a2814-b0e3-4c5a-8919-2cedc3a830de tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:40.208612 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1b2a2814-b0e3-4c5a-8919-2cedc3a830de tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:40.209230 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-1b2a2814-b0e3-4c5a-8919-2cedc3a830de tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lazy-loading 'fault' on Instance uuid 34f1cea3-93d7-4092-9cf2-814af9af3984 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:58:41.138519 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1b2a2814-b0e3-4c5a-8919-2cedc3a830de tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:41.154934 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1b2a2814-b0e3-4c5a-8919-2cedc3a830de tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1308 microversion: 2.1 time: 1.048267 Jun 16 14:58:41.156042 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 220/450] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:40 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1308 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:41.176705 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-1002e327-f4c1-4720-9923-028c5f942a26 req-fd5bc6a0-8be1-44e3-b723-ac8d81425ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f1cea3-93d7-4092-9cf2-814af9af3984", "name": "network-vif-deleted", "tag": "f1f48c07-1fe5-4833-8ce2-fc083a91f73f"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:41.192117 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-1002e327-f4c1-4720-9923-028c5f942a26 req-fd5bc6a0-8be1-44e3-b723-ac8d81425ae3 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:41.193228 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-1002e327-f4c1-4720-9923-028c5f942a26 req-fd5bc6a0-8be1-44e3-b723-ac8d81425ae3 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:41.226762 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-1002e327-f4c1-4720-9923-028c5f942a26 req-fd5bc6a0-8be1-44e3-b723-ac8d81425ae3 service nova] Creating event network-vif-deleted:f1f48c07-1fe5-4833-8ce2-fc083a91f73f for instance 34f1cea3-93d7-4092-9cf2-814af9af3984 on hv-cinder-83716 Jun 16 14:58:41.229810 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-8c52276d-542a-4e28-a0ee-8f978b451f18 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:41.237174 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-1002e327-f4c1-4720-9923-028c5f942a26 req-fd5bc6a0-8be1-44e3-b723-ac8d81425ae3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066782 Jun 16 14:58:41.238222 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 221/451] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:58:41.247819 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c6e55f99-b6c5-475d-afb2-d2cec9b299e0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:41.249969 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c6e55f99-b6c5-475d-afb2-d2cec9b299e0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:41.254018 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8c52276d-542a-4e28-a0ee-8f978b451f18 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1314 microversion: 2.1 time: 1.600540 Jun 16 14:58:41.260520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c6e55f99-b6c5-475d-afb2-d2cec9b299e0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:41.261441 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c6e55f99-b6c5-475d-afb2-d2cec9b299e0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:41.262750 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c6e55f99-b6c5-475d-afb2-d2cec9b299e0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:41.263546 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c6e55f99-b6c5-475d-afb2-d2cec9b299e0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:41.264886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 231/452] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:39 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1314 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:41.270746 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-5bf6771d-6a90-42f2-a30f-67cb35aa112f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:41.271368 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-5bf6771d-6a90-42f2-a30f-67cb35aa112f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:41.303654 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5bf6771d-6a90-42f2-a30f-67cb35aa112f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:41.320606 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5bf6771d-6a90-42f2-a30f-67cb35aa112f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:41.321463 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5bf6771d-6a90-42f2-a30f-67cb35aa112f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:41.321912 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5bf6771d-6a90-42f2-a30f-67cb35aa112f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:41.717840 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c6e55f99-b6c5-475d-afb2-d2cec9b299e0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:41.726993 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c6e55f99-b6c5-475d-afb2-d2cec9b299e0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:41.736670 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c6e55f99-b6c5-475d-afb2-d2cec9b299e0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:41.738855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c6e55f99-b6c5-475d-afb2-d2cec9b299e0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.499064 Jun 16 14:58:41.743986 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 222/453] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:41 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:41.754092 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-f6e471cc-3c3f-4892-8bd0-d4eec30cdbf9 req-080beb0f-4d7c-49c6-96f8-318676f13908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "120f403f-a9e1-4359-9e3b-6d3a98a5c7af", "tag": "b069c8fa-e747-4081-a398-e94c5755297b"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:41.792374 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-f6e471cc-3c3f-4892-8bd0-d4eec30cdbf9 req-080beb0f-4d7c-49c6-96f8-318676f13908 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:41.792969 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-f6e471cc-3c3f-4892-8bd0-d4eec30cdbf9 req-080beb0f-4d7c-49c6-96f8-318676f13908 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:41.810193 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-f6e471cc-3c3f-4892-8bd0-d4eec30cdbf9 req-080beb0f-4d7c-49c6-96f8-318676f13908 service nova] Creating event network-changed:b069c8fa-e747-4081-a398-e94c5755297b for instance 120f403f-a9e1-4359-9e3b-6d3a98a5c7af on hv-cinder-83716 Jun 16 14:58:41.825621 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-f6e471cc-3c3f-4892-8bd0-d4eec30cdbf9 req-080beb0f-4d7c-49c6-96f8-318676f13908 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080208 Jun 16 14:58:41.827178 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 223/454] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:58:41.857458 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-5bf6771d-6a90-42f2-a30f-67cb35aa112f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:41.872813 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-5bf6771d-6a90-42f2-a30f-67cb35aa112f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 0.605866 Jun 16 14:58:41.874991 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 232/455] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:41 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:42.177824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a8de0a00-9623-498e-973a-ec31e1fdcb1d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:42.178532 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a8de0a00-9623-498e-973a-ec31e1fdcb1d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:42.197168 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a8de0a00-9623-498e-973a-ec31e1fdcb1d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:42.197666 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a8de0a00-9623-498e-973a-ec31e1fdcb1d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:42.198519 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a8de0a00-9623-498e-973a-ec31e1fdcb1d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:42.198972 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a8de0a00-9623-498e-973a-ec31e1fdcb1d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:42.250734 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a8de0a00-9623-498e-973a-ec31e1fdcb1d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:42.251620 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a8de0a00-9623-498e-973a-ec31e1fdcb1d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:42.252513 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-a8de0a00-9623-498e-973a-ec31e1fdcb1d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lazy-loading 'fault' on Instance uuid 34f1cea3-93d7-4092-9cf2-814af9af3984 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:58:42.280200 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-13f2b295-f44f-4fd1-927c-d3193bc31446 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:42.282729 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-13f2b295-f44f-4fd1-927c-d3193bc31446 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:42.290979 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-13f2b295-f44f-4fd1-927c-d3193bc31446 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:42.291860 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-13f2b295-f44f-4fd1-927c-d3193bc31446 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:42.292879 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-13f2b295-f44f-4fd1-927c-d3193bc31446 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:42.293658 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-13f2b295-f44f-4fd1-927c-d3193bc31446 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:42.389510 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a8de0a00-9623-498e-973a-ec31e1fdcb1d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:42.393395 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=100 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:42.400877 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a8de0a00-9623-498e-973a-ec31e1fdcb1d tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1308 microversion: 2.1 time: 0.227916 Jun 16 14:58:42.407303 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 224/456] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:42 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1308 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:42.743618 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-13f2b295-f44f-4fd1-927c-d3193bc31446 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:42.762955 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-05549e60-5710-4742-8a41-3e6a7b813f5a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:42.764152 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-05549e60-5710-4742-8a41-3e6a7b813f5a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:42.781056 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-13f2b295-f44f-4fd1-927c-d3193bc31446 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1314 microversion: 2.1 time: 0.511780 Jun 16 14:58:42.782940 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-05549e60-5710-4742-8a41-3e6a7b813f5a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:42.785338 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-05549e60-5710-4742-8a41-3e6a7b813f5a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:42.792878 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-05549e60-5710-4742-8a41-3e6a7b813f5a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:42.794389 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-05549e60-5710-4742-8a41-3e6a7b813f5a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:42.795757 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 233/457] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:42 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:42.895461 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-45f151ce-558e-4790-9ecc-b4510c7350b1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:42.896471 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-45f151ce-558e-4790-9ecc-b4510c7350b1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:42.920312 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-45f151ce-558e-4790-9ecc-b4510c7350b1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:42.926846 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-45f151ce-558e-4790-9ecc-b4510c7350b1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:42.931737 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-45f151ce-558e-4790-9ecc-b4510c7350b1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:42.940048 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-45f151ce-558e-4790-9ecc-b4510c7350b1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:43.234490 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-45f151ce-558e-4790-9ecc-b4510c7350b1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:43.253866 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-45f151ce-558e-4790-9ecc-b4510c7350b1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 0.366046 Jun 16 14:58:43.260432 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 234/458] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:42 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:43.273046 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-5758f228-8d76-4c2b-be78-cee155f0d1ca tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-987079187", "imageRef": "f2f37ffa-db20-478d-84c0-b429a987933c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2b19b75-a6b3-4999-bad1-72b8dbee6346"}], "security_groups": [{"name": "tempest-securitygroup--780465555"}], "key_name": "tempest-keypair-2102761029", "user_data": "}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:43.280299 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-05549e60-5710-4742-8a41-3e6a7b813f5a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:43.309413 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-05549e60-5710-4742-8a41-3e6a7b813f5a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:43.313779 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-05549e60-5710-4742-8a41-3e6a7b813f5a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:43.316274 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-05549e60-5710-4742-8a41-3e6a7b813f5a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.556774 Jun 16 14:58:43.327085 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 225/459] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:42 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:43.428060 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a944d53e-abdf-4eed-85d9-3bb7c9727c2e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:43.428967 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a944d53e-abdf-4eed-85d9-3bb7c9727c2e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:43.437670 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a944d53e-abdf-4eed-85d9-3bb7c9727c2e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:43.439195 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a944d53e-abdf-4eed-85d9-3bb7c9727c2e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:43.440361 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a944d53e-abdf-4eed-85d9-3bb7c9727c2e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:43.440968 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a944d53e-abdf-4eed-85d9-3bb7c9727c2e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:43.485661 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a944d53e-abdf-4eed-85d9-3bb7c9727c2e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:43.486876 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a944d53e-abdf-4eed-85d9-3bb7c9727c2e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:43.488549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-a944d53e-abdf-4eed-85d9-3bb7c9727c2e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lazy-loading 'fault' on Instance uuid 34f1cea3-93d7-4092-9cf2-814af9af3984 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:58:43.653585 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a944d53e-abdf-4eed-85d9-3bb7c9727c2e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:43.682319 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a944d53e-abdf-4eed-85d9-3bb7c9727c2e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1308 microversion: 2.1 time: 0.256732 Jun 16 14:58:43.694554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 226/460] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:43 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1308 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:43.810240 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-24bb02d9-77b2-4c1b-b2b2-5949d19e0960 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:43.811399 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-24bb02d9-77b2-4c1b-b2b2-5949d19e0960 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:43.821283 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-24bb02d9-77b2-4c1b-b2b2-5949d19e0960 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:43.821738 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-24bb02d9-77b2-4c1b-b2b2-5949d19e0960 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:43.825496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-24bb02d9-77b2-4c1b-b2b2-5949d19e0960 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:43.827450 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-24bb02d9-77b2-4c1b-b2b2-5949d19e0960 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:44.119767 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-24bb02d9-77b2-4c1b-b2b2-5949d19e0960 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:44.131893 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-24bb02d9-77b2-4c1b-b2b2-5949d19e0960 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1314 microversion: 2.1 time: 0.325317 Jun 16 14:58:44.132700 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 227/461] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:43 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:44.271156 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8e253727-47bf-4cef-9e92-d3f5bfbb36bc tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:44.271722 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8e253727-47bf-4cef-9e92-d3f5bfbb36bc tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:44.287331 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8e253727-47bf-4cef-9e92-d3f5bfbb36bc tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:44.288242 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8e253727-47bf-4cef-9e92-d3f5bfbb36bc tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:44.289169 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8e253727-47bf-4cef-9e92-d3f5bfbb36bc tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:44.289703 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8e253727-47bf-4cef-9e92-d3f5bfbb36bc tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:44.612955 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8e253727-47bf-4cef-9e92-d3f5bfbb36bc tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:44.621225 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8e253727-47bf-4cef-9e92-d3f5bfbb36bc tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 0.354495 Jun 16 14:58:44.621820 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 228/462] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:44 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:44.650507 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c260df1b-7a22-4dea-9dae-4444e3ef30ba tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:44.651723 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c260df1b-7a22-4dea-9dae-4444e3ef30ba tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:44.673581 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c260df1b-7a22-4dea-9dae-4444e3ef30ba tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:44.683179 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c260df1b-7a22-4dea-9dae-4444e3ef30ba tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:44.684772 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c260df1b-7a22-4dea-9dae-4444e3ef30ba tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:44.685765 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c260df1b-7a22-4dea-9dae-4444e3ef30ba tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:45.463527 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c260df1b-7a22-4dea-9dae-4444e3ef30ba tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:45.478467 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c260df1b-7a22-4dea-9dae-4444e3ef30ba tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:45.480171 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c260df1b-7a22-4dea-9dae-4444e3ef30ba tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:45.485229 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c260df1b-7a22-4dea-9dae-4444e3ef30ba tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.848526 Jun 16 14:58:45.498995 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 229/463] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:44 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:45.521695 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8a02f501-912c-4b22-99d0-792c31335e9b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:45.522884 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8a02f501-912c-4b22-99d0-792c31335e9b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:45.540654 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8a02f501-912c-4b22-99d0-792c31335e9b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:45.541600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8a02f501-912c-4b22-99d0-792c31335e9b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:45.545251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8a02f501-912c-4b22-99d0-792c31335e9b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:45.545819 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8a02f501-912c-4b22-99d0-792c31335e9b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:45.616107 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8a02f501-912c-4b22-99d0-792c31335e9b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:45.617669 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8a02f501-912c-4b22-99d0-792c31335e9b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:45.619414 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-8a02f501-912c-4b22-99d0-792c31335e9b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lazy-loading 'fault' on Instance uuid 34f1cea3-93d7-4092-9cf2-814af9af3984 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:58:45.696981 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8a02f501-912c-4b22-99d0-792c31335e9b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:45.708946 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8a02f501-912c-4b22-99d0-792c31335e9b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 200 len: 1308 microversion: 2.1 time: 0.196795 Jun 16 14:58:45.709967 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 230/464] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:45 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 1308 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:45.715610 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f2d5b175-bf7b-48f9-9864-5f9dac8dcdb3 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:45.716498 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f2d5b175-bf7b-48f9-9864-5f9dac8dcdb3 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:45.725365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f2d5b175-bf7b-48f9-9864-5f9dac8dcdb3 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:45.725973 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f2d5b175-bf7b-48f9-9864-5f9dac8dcdb3 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:45.727136 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f2d5b175-bf7b-48f9-9864-5f9dac8dcdb3 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:45.727672 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f2d5b175-bf7b-48f9-9864-5f9dac8dcdb3 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:46.131385 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f2d5b175-bf7b-48f9-9864-5f9dac8dcdb3 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:46.141122 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f2d5b175-bf7b-48f9-9864-5f9dac8dcdb3 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1314 microversion: 2.1 time: 0.430002 Jun 16 14:58:46.162110 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 231/465] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:45 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:46.162110 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-93ac8b09-a130-4494-80cd-0a82e42c782f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:46.162110 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-93ac8b09-a130-4494-80cd-0a82e42c782f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:46.174396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-93ac8b09-a130-4494-80cd-0a82e42c782f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:46.175019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-93ac8b09-a130-4494-80cd-0a82e42c782f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:46.175959 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-93ac8b09-a130-4494-80cd-0a82e42c782f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:46.176505 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-93ac8b09-a130-4494-80cd-0a82e42c782f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:46.497803 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-93ac8b09-a130-4494-80cd-0a82e42c782f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:46.509541 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-93ac8b09-a130-4494-80cd-0a82e42c782f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 0.354673 Jun 16 14:58:46.584843 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 232/466] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:46 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:46.584843 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-35dfeef8-7c8b-497a-b770-890151101c5a req-3e926fc5-42a0-4595-b6b5-3b83459dd4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57ad15bd-b09a-4896-97fd-86b4dc5cdab0", "name": "network-vif-plugged", "status": "completed", "tag": "fad8a98c-0e41-4630-8105-a78c2c1e11d8"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:46.584843 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-35dfeef8-7c8b-497a-b770-890151101c5a req-3e926fc5-42a0-4595-b6b5-3b83459dd4a2 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:46.584843 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-35dfeef8-7c8b-497a-b770-890151101c5a req-3e926fc5-42a0-4595-b6b5-3b83459dd4a2 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:46.585511 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-35dfeef8-7c8b-497a-b770-890151101c5a req-3e926fc5-42a0-4595-b6b5-3b83459dd4a2 service nova] Creating event network-vif-plugged:fad8a98c-0e41-4630-8105-a78c2c1e11d8 for instance 57ad15bd-b09a-4896-97fd-86b4dc5cdab0 on hv-cinder-83716 Jun 16 14:58:46.592756 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-35dfeef8-7c8b-497a-b770-890151101c5a req-3e926fc5-42a0-4595-b6b5-3b83459dd4a2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077538 Jun 16 14:58:46.593972 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 233/467] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:58:46.606700 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e44fe1b5-0be4-442a-b9a2-8e3d74132511 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:46.610537 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e44fe1b5-0be4-442a-b9a2-8e3d74132511 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:46.619927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e44fe1b5-0be4-442a-b9a2-8e3d74132511 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:46.620848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e44fe1b5-0be4-442a-b9a2-8e3d74132511 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:46.623390 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e44fe1b5-0be4-442a-b9a2-8e3d74132511 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:46.625032 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e44fe1b5-0be4-442a-b9a2-8e3d74132511 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:46.818102 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.network.neutron [None req-5758f228-8d76-4c2b-be78-cee155f0d1ca tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] validate_networks() for [('f2b19b75-a6b3-4999-bad1-72b8dbee6346', None, None, None, None, None)] {{(pid=117443) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:58:46.879357 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e44fe1b5-0be4-442a-b9a2-8e3d74132511 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:46.888097 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e44fe1b5-0be4-442a-b9a2-8e3d74132511 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:46.890405 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e44fe1b5-0be4-442a-b9a2-8e3d74132511 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:46.891571 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e44fe1b5-0be4-442a-b9a2-8e3d74132511 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.296504 Jun 16 14:58:46.892275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 234/468] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:46 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:46.897172 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e8dfee04-8224-4bce-9d81-24856421843b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:46.897777 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e8dfee04-8224-4bce-9d81-24856421843b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 34f1cea3-93d7-4092-9cf2-814af9af3984] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:46.908213 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e8dfee04-8224-4bce-9d81-24856421843b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:46.908664 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e8dfee04-8224-4bce-9d81-24856421843b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:46.909439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e8dfee04-8224-4bce-9d81-24856421843b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:46.909866 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e8dfee04-8224-4bce-9d81-24856421843b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:46.923796 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-e8dfee04-8224-4bce-9d81-24856421843b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] HTTP exception thrown: Instance 34f1cea3-93d7-4092-9cf2-814af9af3984 could not be found. Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e8dfee04-8224-4bce-9d81-24856421843b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Request method failure captured: Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 HTTP/1.1 Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0THEFtKCz9ZvSmtcD6GGWN4gyMIUGda9iKdXUKlakFbCEQtefR6wMPfO1LGH84XK40wVd6CSiJn-bB85B7gYjCSm-lLzBnTKpWyWcigp_72uioxCFoxMzH_bh55NvxkCI8P1zw7MdQ-XqjZQm6hkdFxvgk8C5EG_fVMh3Z3SuK1SIw Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: cef1f9d9b1a74f84a3cdda0feb12ad0c Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-VolumesSnapshotTestJSON-642161874 Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 14:58:46.925781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 14:58:46.927549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cef1f9d9b1a74f84a3cdda0feb12ad0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cef1f9d9b1a74f84a3cdda0feb12ad0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cef1f9d9b1a74f84a3cdda0feb12ad0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cef1f9d9b1a74f84a3cdda0feb12ad0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:58:46.927549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-VolumesSnapshotTestJSON-642161874 Jun 16 14:58:46.927549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: cef1f9d9b1a74f84a3cdda0feb12ad0c Jun 16 14:58:46.927549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-642161874 Jun 16 14:58:46.927549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-VolumesSnapshotTestJSON-642161874-project Jun 16 14:58:46.927549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 14:58:46.927549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 14:58:46.927549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 4b6c7f2af8fa4f68a80d006105a96ee3 Jun 16 14:58:46.927549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-VolumesSnapshotTestJSON-642161874-project Jun 16 14:58:46.927549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 14:58:46.927549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance 34f1cea3-93d7-4092-9cf2-814af9af3984 could not be found. Jun 16 14:58:46.927549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': '34f1cea3-93d7-4092-9cf2-814af9af3984'} Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34f1cea3-93d7-4092-9cf2-814af9af3984 could not be found. Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:58:46.928631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:58:46.930897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:58:46.930897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:58:46.930897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:58:46.930897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:58:46.930897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:58:46.930897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:58:46.930897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:58:46.930897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34f1cea3-93d7-4092-9cf2-814af9af3984 could not be found. Jun 16 14:58:46.930897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:58:46.930897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:58:46.930897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:58:46.930897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:58:46.930897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:58:46.930897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:58:46.930897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:58:46.930897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:58:46.930897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34f1cea3-93d7-4092-9cf2-814af9af3984 could not be found. Jun 16 14:58:46.930897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:58:46.932318 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e8dfee04-8224-4bce-9d81-24856421843b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Returning 404 to user: Instance 34f1cea3-93d7-4092-9cf2-814af9af3984 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:58:46.932318 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e8dfee04-8224-4bce-9d81-24856421843b tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984" status: 404 len: 111 microversion: 2.1 time: 0.033984 Jun 16 14:58:46.932318 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 235/469] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:46 2022] GET /compute/v2.1/servers/34f1cea3-93d7-4092-9cf2-814af9af3984 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:58:47.170304 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-37e842af-8a8e-4e81-8634-c74c1041b94d tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:47.171107 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-37e842af-8a8e-4e81-8634-c74c1041b94d tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:47.177611 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-37e842af-8a8e-4e81-8634-c74c1041b94d tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:47.178393 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-37e842af-8a8e-4e81-8634-c74c1041b94d tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:47.179889 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-37e842af-8a8e-4e81-8634-c74c1041b94d tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:47.180130 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-37e842af-8a8e-4e81-8634-c74c1041b94d tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:47.585251 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=4 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:47.636594 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-37e842af-8a8e-4e81-8634-c74c1041b94d tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:47.645307 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-37e842af-8a8e-4e81-8634-c74c1041b94d tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1314 microversion: 2.1 time: 0.479442 Jun 16 14:58:47.646545 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 236/470] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:47 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:47.651862 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a02ebf7f-62d0-4797-b3ec-20b9cb1f0e25 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:47.652755 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a02ebf7f-62d0-4797-b3ec-20b9cb1f0e25 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:47.661688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a02ebf7f-62d0-4797-b3ec-20b9cb1f0e25 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:47.662013 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a02ebf7f-62d0-4797-b3ec-20b9cb1f0e25 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:47.663380 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a02ebf7f-62d0-4797-b3ec-20b9cb1f0e25 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:47.664021 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a02ebf7f-62d0-4797-b3ec-20b9cb1f0e25 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:47.679245 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-5758f228-8d76-4c2b-be78-cee155f0d1ca tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Flavor limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:58:47.679484 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-5758f228-8d76-4c2b-be78-cee155f0d1ca tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Image limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:58:47.679987 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-5758f228-8d76-4c2b-be78-cee155f0d1ca tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Flavor pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:58:47.680496 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-5758f228-8d76-4c2b-be78-cee155f0d1ca tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Image pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:58:47.680800 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-5758f228-8d76-4c2b-be78-cee155f0d1ca tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:58:47.696018 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5758f228-8d76-4c2b-be78-cee155f0d1ca tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:47.696671 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5758f228-8d76-4c2b-be78-cee155f0d1ca tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:47.697630 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5758f228-8d76-4c2b-be78-cee155f0d1ca tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:47.698227 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5758f228-8d76-4c2b-be78-cee155f0d1ca tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:47.717926 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-5758f228-8d76-4c2b-be78-cee155f0d1ca tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Getting quotas for project 2b653a9971874ddb8a49b265e3783ff3. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:58:47.722322 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-5758f228-8d76-4c2b-be78-cee155f0d1ca tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Getting quotas for user dc31b47df1904f9da0b5c7f370b74132 and project 2b653a9971874ddb8a49b265e3783ff3. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:58:47.737086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-5758f228-8d76-4c2b-be78-cee155f0d1ca tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Going to run 1 instances... {{(pid=117443) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:58:47.744164 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-5758f228-8d76-4c2b-be78-cee155f0d1ca tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2f37ffa-db20-478d-84c0-b429a987933c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:58:47.897272 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-5758f228-8d76-4c2b-be78-cee155f0d1ca tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.629236 Jun 16 14:58:47.901265 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 235/471] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 14:58:43 2022] POST /compute/v2.1/servers => generated 408 bytes in 4640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:58:47.913520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-087185a4-89ed-4c9e-af1a-95e384dfe519 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:47.913751 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a02ebf7f-62d0-4797-b3ec-20b9cb1f0e25 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:47.932427 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a02ebf7f-62d0-4797-b3ec-20b9cb1f0e25 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 0.278267 Jun 16 14:58:47.932427 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 237/472] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:47 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:47.933415 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-087185a4-89ed-4c9e-af1a-95e384dfe519 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:47.936306 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-db58b6e2-fdac-4f74-a606-401e62cc2160 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:47.937377 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-db58b6e2-fdac-4f74-a606-401e62cc2160 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:47.958459 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-db58b6e2-fdac-4f74-a606-401e62cc2160 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:47.959080 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-db58b6e2-fdac-4f74-a606-401e62cc2160 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:47.960902 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-db58b6e2-fdac-4f74-a606-401e62cc2160 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:47.962607 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-db58b6e2-fdac-4f74-a606-401e62cc2160 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:48.019638 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-087185a4-89ed-4c9e-af1a-95e384dfe519 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:48.029069 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-087185a4-89ed-4c9e-af1a-95e384dfe519 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1245 microversion: 2.1 time: 0.121045 Jun 16 14:58:48.031039 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 236/473] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:47 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1245 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:48.211800 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-db58b6e2-fdac-4f74-a606-401e62cc2160 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:48.233907 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-db58b6e2-fdac-4f74-a606-401e62cc2160 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:48.235637 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-db58b6e2-fdac-4f74-a606-401e62cc2160 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:48.237017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-db58b6e2-fdac-4f74-a606-401e62cc2160 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.307725 Jun 16 14:58:48.237494 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 238/474] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:47 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:48.666635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f171741d-110c-49e7-9543-b40a7e8ef877 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:48.667434 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f171741d-110c-49e7-9543-b40a7e8ef877 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:48.680247 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f171741d-110c-49e7-9543-b40a7e8ef877 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:48.681566 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f171741d-110c-49e7-9543-b40a7e8ef877 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:48.682526 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f171741d-110c-49e7-9543-b40a7e8ef877 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:48.683111 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f171741d-110c-49e7-9543-b40a7e8ef877 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:48.857971 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f171741d-110c-49e7-9543-b40a7e8ef877 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:48.866621 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f171741d-110c-49e7-9543-b40a7e8ef877 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1314 microversion: 2.1 time: 0.203982 Jun 16 14:58:48.867519 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 237/475] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:48 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:48.947511 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-eea22de6-0a51-4667-a67b-15dbe185d79a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:48.948466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-eea22de6-0a51-4667-a67b-15dbe185d79a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:48.959441 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-eea22de6-0a51-4667-a67b-15dbe185d79a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:48.959937 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-eea22de6-0a51-4667-a67b-15dbe185d79a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:48.960726 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-eea22de6-0a51-4667-a67b-15dbe185d79a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:48.961167 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-eea22de6-0a51-4667-a67b-15dbe185d79a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:49.048112 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7c7ab817-a53b-4a83-b235-7fdde05ddb42 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:49.049870 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7c7ab817-a53b-4a83-b235-7fdde05ddb42 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:49.062196 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7c7ab817-a53b-4a83-b235-7fdde05ddb42 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:49.062955 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7c7ab817-a53b-4a83-b235-7fdde05ddb42 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:49.064011 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7c7ab817-a53b-4a83-b235-7fdde05ddb42 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:49.064590 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7c7ab817-a53b-4a83-b235-7fdde05ddb42 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:49.137085 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-eea22de6-0a51-4667-a67b-15dbe185d79a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:49.145739 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-eea22de6-0a51-4667-a67b-15dbe185d79a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 0.202692 Jun 16 14:58:49.146938 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 239/476] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:48 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:49.192956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7c7ab817-a53b-4a83-b235-7fdde05ddb42 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:49.202167 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7c7ab817-a53b-4a83-b235-7fdde05ddb42 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1249 microversion: 2.1 time: 0.158793 Jun 16 14:58:49.202750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 238/477] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:49 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1249 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:49.265890 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cd60c248-e374-49ca-a173-d39ee8c258e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:49.267078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-cd60c248-e374-49ca-a173-d39ee8c258e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:49.273637 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cd60c248-e374-49ca-a173-d39ee8c258e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:49.274424 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cd60c248-e374-49ca-a173-d39ee8c258e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:49.275511 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cd60c248-e374-49ca-a173-d39ee8c258e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:49.276098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cd60c248-e374-49ca-a173-d39ee8c258e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:49.447605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cd60c248-e374-49ca-a173-d39ee8c258e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:49.460561 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cd60c248-e374-49ca-a173-d39ee8c258e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:49.463904 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cd60c248-e374-49ca-a173-d39ee8c258e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:49.465993 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-cd60c248-e374-49ca-a173-d39ee8c258e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.203816 Jun 16 14:58:49.466810 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 240/478] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:49 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:49.893001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-cb3fa04b-be16-48ac-b240-7a2247f274cf tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:49.894839 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-cb3fa04b-be16-48ac-b240-7a2247f274cf tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:49.903490 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-cb3fa04b-be16-48ac-b240-7a2247f274cf tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:49.910105 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-cb3fa04b-be16-48ac-b240-7a2247f274cf tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:49.911800 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-cb3fa04b-be16-48ac-b240-7a2247f274cf tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:49.912738 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-cb3fa04b-be16-48ac-b240-7a2247f274cf tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:50.140661 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-cb3fa04b-be16-48ac-b240-7a2247f274cf tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:50.150276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-cb3fa04b-be16-48ac-b240-7a2247f274cf tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1314 microversion: 2.1 time: 0.264521 Jun 16 14:58:50.165685 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 239/479] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:49 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:50.168950 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-96bb62f9-f060-4d50-92cb-1cb59a4fe906 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:50.169592 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-96bb62f9-f060-4d50-92cb-1cb59a4fe906 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:50.178145 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-96bb62f9-f060-4d50-92cb-1cb59a4fe906 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:50.178874 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-96bb62f9-f060-4d50-92cb-1cb59a4fe906 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:50.179888 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-96bb62f9-f060-4d50-92cb-1cb59a4fe906 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:50.180485 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-96bb62f9-f060-4d50-92cb-1cb59a4fe906 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:50.224552 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1703e66d-1142-461d-a95d-6e6d411b2b77 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:50.225488 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-1703e66d-1142-461d-a95d-6e6d411b2b77 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:50.232601 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1703e66d-1142-461d-a95d-6e6d411b2b77 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:50.233324 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1703e66d-1142-461d-a95d-6e6d411b2b77 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:50.234484 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1703e66d-1142-461d-a95d-6e6d411b2b77 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:50.234890 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1703e66d-1142-461d-a95d-6e6d411b2b77 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:50.655642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1703e66d-1142-461d-a95d-6e6d411b2b77 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:50.675743 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1703e66d-1142-461d-a95d-6e6d411b2b77 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1249 microversion: 2.1 time: 0.460006 Jun 16 14:58:50.687765 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 240/480] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:50 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1249 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:50.696228 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-2b1ce088-38e1-4257-8621-33777b847564 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:50.697910 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-2b1ce088-38e1-4257-8621-33777b847564 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:50.705108 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2b1ce088-38e1-4257-8621-33777b847564 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:50.705872 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2b1ce088-38e1-4257-8621-33777b847564 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:50.707039 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2b1ce088-38e1-4257-8621-33777b847564 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:50.708248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2b1ce088-38e1-4257-8621-33777b847564 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:50.747575 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-96bb62f9-f060-4d50-92cb-1cb59a4fe906 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:50.763428 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-96bb62f9-f060-4d50-92cb-1cb59a4fe906 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 0.602686 Jun 16 14:58:50.767726 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 241/481] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:50 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:50.908327 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2b1ce088-38e1-4257-8621-33777b847564 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:50.918692 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2b1ce088-38e1-4257-8621-33777b847564 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:50.921198 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2b1ce088-38e1-4257-8621-33777b847564 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:50.922614 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-2b1ce088-38e1-4257-8621-33777b847564 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.233569 Jun 16 14:58:50.923250 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 241/482] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:50 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:51.177174 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-963697af-da28-4cb1-b43c-f397a7f8df9b tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:51.178416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-963697af-da28-4cb1-b43c-f397a7f8df9b tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:51.192850 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-963697af-da28-4cb1-b43c-f397a7f8df9b tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:51.195357 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-963697af-da28-4cb1-b43c-f397a7f8df9b tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:51.197177 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-963697af-da28-4cb1-b43c-f397a7f8df9b tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:51.198386 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-963697af-da28-4cb1-b43c-f397a7f8df9b tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:51.227762 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=100 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:51.701125 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7a174b90-7759-42a1-b1c3-5ae0a63a9eaf tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:51.702925 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7a174b90-7759-42a1-b1c3-5ae0a63a9eaf tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:51.711832 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7a174b90-7759-42a1-b1c3-5ae0a63a9eaf tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:51.712785 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7a174b90-7759-42a1-b1c3-5ae0a63a9eaf tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:51.715525 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7a174b90-7759-42a1-b1c3-5ae0a63a9eaf tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:51.724235 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7a174b90-7759-42a1-b1c3-5ae0a63a9eaf tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:51.842938 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7a174b90-7759-42a1-b1c3-5ae0a63a9eaf tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:51.846793 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-963697af-da28-4cb1-b43c-f397a7f8df9b tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:51.858173 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7a174b90-7759-42a1-b1c3-5ae0a63a9eaf tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1297 microversion: 2.1 time: 0.168496 Jun 16 14:58:51.860662 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-963697af-da28-4cb1-b43c-f397a7f8df9b tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1314 microversion: 2.1 time: 0.689625 Jun 16 14:58:51.863418 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 242/483] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:51 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1314 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:51.870642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 242/484] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:51 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1297 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:51.876245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5159aa88-9ac1-446d-bd69-99ecf9bbdc1f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:51.878309 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5159aa88-9ac1-446d-bd69-99ecf9bbdc1f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:51.892079 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5159aa88-9ac1-446d-bd69-99ecf9bbdc1f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:51.892793 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5159aa88-9ac1-446d-bd69-99ecf9bbdc1f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:51.893999 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5159aa88-9ac1-446d-bd69-99ecf9bbdc1f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:51.894595 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5159aa88-9ac1-446d-bd69-99ecf9bbdc1f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:51.948750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-2c8c5902-e852-4f14-8266-728a4c1e76b3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:51.950911 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-2c8c5902-e852-4f14-8266-728a4c1e76b3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:51.969702 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2c8c5902-e852-4f14-8266-728a4c1e76b3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:51.970591 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2c8c5902-e852-4f14-8266-728a4c1e76b3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:51.972734 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2c8c5902-e852-4f14-8266-728a4c1e76b3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:51.974704 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2c8c5902-e852-4f14-8266-728a4c1e76b3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:52.528744 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5159aa88-9ac1-446d-bd69-99ecf9bbdc1f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:52.541754 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5159aa88-9ac1-446d-bd69-99ecf9bbdc1f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 0.676666 Jun 16 14:58:52.554448 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 243/485] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:51 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:52.612080 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2c8c5902-e852-4f14-8266-728a4c1e76b3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:52.626001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2c8c5902-e852-4f14-8266-728a4c1e76b3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:52.628015 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2c8c5902-e852-4f14-8266-728a4c1e76b3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:52.629701 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-2c8c5902-e852-4f14-8266-728a4c1e76b3 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.690306 Jun 16 14:58:52.640498 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 243/486] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:51 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:58:52.879894 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-31face1b-3bbe-4edd-9949-8426ab2c5e8f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:52.882445 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-db6246c4-a8b4-4713-8cd1-c4e731769122 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:52.883071 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-db6246c4-a8b4-4713-8cd1-c4e731769122 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:52.886527 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-31face1b-3bbe-4edd-9949-8426ab2c5e8f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:52.896116 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-31face1b-3bbe-4edd-9949-8426ab2c5e8f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:52.896620 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-31face1b-3bbe-4edd-9949-8426ab2c5e8f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:52.897572 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-31face1b-3bbe-4edd-9949-8426ab2c5e8f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:52.897885 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-db6246c4-a8b4-4713-8cd1-c4e731769122 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:52.898339 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-db6246c4-a8b4-4713-8cd1-c4e731769122 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:52.899213 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-31face1b-3bbe-4edd-9949-8426ab2c5e8f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:52.899358 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-db6246c4-a8b4-4713-8cd1-c4e731769122 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:52.899740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-db6246c4-a8b4-4713-8cd1-c4e731769122 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:53.016772 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-31face1b-3bbe-4edd-9949-8426ab2c5e8f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:53.028020 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-31face1b-3bbe-4edd-9949-8426ab2c5e8f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1297 microversion: 2.1 time: 0.154823 Jun 16 14:58:53.030011 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 244/487] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:52 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1297 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:53.203118 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-db6246c4-a8b4-4713-8cd1-c4e731769122 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:53.211823 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-db6246c4-a8b4-4713-8cd1-c4e731769122 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1464 microversion: 2.1 time: 0.336512 Jun 16 14:58:53.212764 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 244/488] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:52 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1464 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:53.270275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0969646f-ea59-4dcb-808b-01e47bcf5a57 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:53.270863 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0969646f-ea59-4dcb-808b-01e47bcf5a57 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:53.284978 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0969646f-ea59-4dcb-808b-01e47bcf5a57 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:53.287243 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0969646f-ea59-4dcb-808b-01e47bcf5a57 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:53.288533 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0969646f-ea59-4dcb-808b-01e47bcf5a57 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:53.288979 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0969646f-ea59-4dcb-808b-01e47bcf5a57 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:53.345152 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0969646f-ea59-4dcb-808b-01e47bcf5a57 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:58:53.498506 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0969646f-ea59-4dcb-808b-01e47bcf5a57 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "DELETE /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 204 len: 0 microversion: 2.1 time: 0.231312 Jun 16 14:58:53.499115 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 245/489] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 14:58:53 2022] DELETE /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:58:53.509221 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-222f9ed0-bb9e-4e2c-8481-3a3a66f9f59e tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:53.509878 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-222f9ed0-bb9e-4e2c-8481-3a3a66f9f59e tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:53.525832 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-222f9ed0-bb9e-4e2c-8481-3a3a66f9f59e tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:53.527605 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-222f9ed0-bb9e-4e2c-8481-3a3a66f9f59e tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:53.529013 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-222f9ed0-bb9e-4e2c-8481-3a3a66f9f59e tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:53.533652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-222f9ed0-bb9e-4e2c-8481-3a3a66f9f59e tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:53.567490 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c624ff04-4d1c-47ad-b99a-0ed34c78a8d1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:53.570643 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c624ff04-4d1c-47ad-b99a-0ed34c78a8d1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:53.594798 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c624ff04-4d1c-47ad-b99a-0ed34c78a8d1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:53.595598 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c624ff04-4d1c-47ad-b99a-0ed34c78a8d1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:53.597246 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c624ff04-4d1c-47ad-b99a-0ed34c78a8d1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:53.598084 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c624ff04-4d1c-47ad-b99a-0ed34c78a8d1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:53.814251 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-222f9ed0-bb9e-4e2c-8481-3a3a66f9f59e tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:53.824436 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-222f9ed0-bb9e-4e2c-8481-3a3a66f9f59e tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1470 microversion: 2.1 time: 0.320532 Jun 16 14:58:53.825227 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 245/490] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:53 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1470 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:53.838814 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b1954f0f-0679-49e1-babf-bebe90a5de7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:53.839431 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b1954f0f-0679-49e1-babf-bebe90a5de7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:53.851499 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b1954f0f-0679-49e1-babf-bebe90a5de7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:53.853461 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b1954f0f-0679-49e1-babf-bebe90a5de7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:53.854650 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b1954f0f-0679-49e1-babf-bebe90a5de7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:53.855300 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b1954f0f-0679-49e1-babf-bebe90a5de7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:53.910329 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c624ff04-4d1c-47ad-b99a-0ed34c78a8d1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:53.932097 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c624ff04-4d1c-47ad-b99a-0ed34c78a8d1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 0.370519 Jun 16 14:58:53.934231 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 246/491] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:53 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:54.047111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-47432f28-b99d-4094-a043-45e584da1411 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:54.047776 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-47432f28-b99d-4094-a043-45e584da1411 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:54.057629 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-47432f28-b99d-4094-a043-45e584da1411 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:54.058588 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-47432f28-b99d-4094-a043-45e584da1411 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:54.060816 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-47432f28-b99d-4094-a043-45e584da1411 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:54.061664 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-47432f28-b99d-4094-a043-45e584da1411 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:54.084407 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b1954f0f-0679-49e1-babf-bebe90a5de7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:54.114392 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b1954f0f-0679-49e1-babf-bebe90a5de7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:54.116863 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b1954f0f-0679-49e1-babf-bebe90a5de7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:54.118117 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b1954f0f-0679-49e1-babf-bebe90a5de7a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.292157 Jun 16 14:58:54.124671 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 246/492] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:53 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:54.215403 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-47432f28-b99d-4094-a043-45e584da1411 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:54.223848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-47432f28-b99d-4094-a043-45e584da1411 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1305 microversion: 2.1 time: 0.180521 Jun 16 14:58:54.231751 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 247/493] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:54 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1305 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:54.850055 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a6f72146-e08f-403c-8fcb-72c1e2f18c94 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:54.850987 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a6f72146-e08f-403c-8fcb-72c1e2f18c94 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:54.858393 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a6f72146-e08f-403c-8fcb-72c1e2f18c94 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:54.859478 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a6f72146-e08f-403c-8fcb-72c1e2f18c94 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:54.860434 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a6f72146-e08f-403c-8fcb-72c1e2f18c94 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:54.861020 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a6f72146-e08f-403c-8fcb-72c1e2f18c94 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:54.868433 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=100 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:54.950733 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c32f07dd-3d08-4c28-bcc0-0258fb7412e8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:54.952474 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c32f07dd-3d08-4c28-bcc0-0258fb7412e8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:54.961106 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c32f07dd-3d08-4c28-bcc0-0258fb7412e8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:54.964135 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c32f07dd-3d08-4c28-bcc0-0258fb7412e8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:54.968956 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c32f07dd-3d08-4c28-bcc0-0258fb7412e8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:54.970743 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c32f07dd-3d08-4c28-bcc0-0258fb7412e8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:55.052669 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a6f72146-e08f-403c-8fcb-72c1e2f18c94 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:55.061594 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a6f72146-e08f-403c-8fcb-72c1e2f18c94 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1470 microversion: 2.1 time: 0.221694 Jun 16 14:58:55.062734 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 247/494] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:54 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1470 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:55.139921 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4ac8f17f-1e6e-4f04-ad1a-d01283666053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:55.141176 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4ac8f17f-1e6e-4f04-ad1a-d01283666053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:55.153105 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4ac8f17f-1e6e-4f04-ad1a-d01283666053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:55.155409 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4ac8f17f-1e6e-4f04-ad1a-d01283666053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:55.158739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4ac8f17f-1e6e-4f04-ad1a-d01283666053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:55.159934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4ac8f17f-1e6e-4f04-ad1a-d01283666053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:55.220485 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c32f07dd-3d08-4c28-bcc0-0258fb7412e8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:55.237225 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c32f07dd-3d08-4c28-bcc0-0258fb7412e8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 0.290180 Jun 16 14:58:55.248934 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 248/495] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:54 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:55.276498 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-101ae545-1499-4cad-b693-43fc66d0d98e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:55.277711 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-101ae545-1499-4cad-b693-43fc66d0d98e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:55.309292 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-101ae545-1499-4cad-b693-43fc66d0d98e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:55.309790 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-101ae545-1499-4cad-b693-43fc66d0d98e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:55.310887 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-101ae545-1499-4cad-b693-43fc66d0d98e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:55.311447 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-101ae545-1499-4cad-b693-43fc66d0d98e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:55.467945 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-101ae545-1499-4cad-b693-43fc66d0d98e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:55.476848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-101ae545-1499-4cad-b693-43fc66d0d98e tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1305 microversion: 2.1 time: 0.220018 Jun 16 14:58:55.477624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 249/496] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:55 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1305 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:55.525036 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4ac8f17f-1e6e-4f04-ad1a-d01283666053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:55.539102 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4ac8f17f-1e6e-4f04-ad1a-d01283666053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:55.543333 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4ac8f17f-1e6e-4f04-ad1a-d01283666053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:55.546055 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4ac8f17f-1e6e-4f04-ad1a-d01283666053 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.411024 Jun 16 14:58:55.547567 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 248/497] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:55 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:58:56.082211 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c41abac2-cd63-474c-9e6e-98bd545412b0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:56.082950 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c41abac2-cd63-474c-9e6e-98bd545412b0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:56.093445 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c41abac2-cd63-474c-9e6e-98bd545412b0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:56.094542 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c41abac2-cd63-474c-9e6e-98bd545412b0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:56.096060 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c41abac2-cd63-474c-9e6e-98bd545412b0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:56.096814 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c41abac2-cd63-474c-9e6e-98bd545412b0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:56.266225 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-dce8021d-d651-4ad0-a370-b00256bc919f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:56.268572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-dce8021d-d651-4ad0-a370-b00256bc919f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:56.271304 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c41abac2-cd63-474c-9e6e-98bd545412b0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:56.280867 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c41abac2-cd63-474c-9e6e-98bd545412b0 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1470 microversion: 2.1 time: 0.205131 Jun 16 14:58:56.282031 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 250/498] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:56 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1470 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:56.283195 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dce8021d-d651-4ad0-a370-b00256bc919f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:56.284128 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dce8021d-d651-4ad0-a370-b00256bc919f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:56.285781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dce8021d-d651-4ad0-a370-b00256bc919f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:56.286973 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dce8021d-d651-4ad0-a370-b00256bc919f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:56.495110 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ddb3bb7d-1788-4430-82b4-82b577995628 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:56.496715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ddb3bb7d-1788-4430-82b4-82b577995628 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:56.512090 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ddb3bb7d-1788-4430-82b4-82b577995628 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:56.512945 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ddb3bb7d-1788-4430-82b4-82b577995628 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:56.515513 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ddb3bb7d-1788-4430-82b4-82b577995628 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:56.516617 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ddb3bb7d-1788-4430-82b4-82b577995628 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:56.538700 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-dce8021d-d651-4ad0-a370-b00256bc919f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:56.556253 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-dce8021d-d651-4ad0-a370-b00256bc919f tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 0.302048 Jun 16 14:58:56.557777 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 249/499] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:56 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:56.573589 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-022cb018-438f-4641-92b4-75bf2c595f05 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:56.574586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-022cb018-438f-4641-92b4-75bf2c595f05 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:56.583640 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-022cb018-438f-4641-92b4-75bf2c595f05 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:56.584691 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-022cb018-438f-4641-92b4-75bf2c595f05 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:56.585608 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-022cb018-438f-4641-92b4-75bf2c595f05 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:56.586180 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-022cb018-438f-4641-92b4-75bf2c595f05 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:56.627237 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ddb3bb7d-1788-4430-82b4-82b577995628 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:56.639829 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ddb3bb7d-1788-4430-82b4-82b577995628 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1305 microversion: 2.1 time: 0.148854 Jun 16 14:58:56.643210 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 251/500] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:56 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1305 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:56.811475 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-022cb018-438f-4641-92b4-75bf2c595f05 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:56.824762 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-022cb018-438f-4641-92b4-75bf2c595f05 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:56.826509 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-022cb018-438f-4641-92b4-75bf2c595f05 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:56.827981 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-022cb018-438f-4641-92b4-75bf2c595f05 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.258553 Jun 16 14:58:56.829071 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 250/501] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:56 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:58:57.309295 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-806f408d-cf58-43ee-aee4-736ee90b3500 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:57.310112 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-806f408d-cf58-43ee-aee4-736ee90b3500 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:57.323500 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-806f408d-cf58-43ee-aee4-736ee90b3500 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:57.324437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-806f408d-cf58-43ee-aee4-736ee90b3500 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:57.325341 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-806f408d-cf58-43ee-aee4-736ee90b3500 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:57.325850 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-806f408d-cf58-43ee-aee4-736ee90b3500 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:57.584608 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-806f408d-cf58-43ee-aee4-736ee90b3500 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:57.586177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a74b598c-0f0b-44d9-b35d-3c82c0fa3636 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:57.586875 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a74b598c-0f0b-44d9-b35d-3c82c0fa3636 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:57.593368 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a74b598c-0f0b-44d9-b35d-3c82c0fa3636 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:57.593998 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a74b598c-0f0b-44d9-b35d-3c82c0fa3636 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:57.595113 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a74b598c-0f0b-44d9-b35d-3c82c0fa3636 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:57.595382 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-806f408d-cf58-43ee-aee4-736ee90b3500 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1470 microversion: 2.1 time: 0.290053 Jun 16 14:58:57.595908 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a74b598c-0f0b-44d9-b35d-3c82c0fa3636 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:57.596436 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 252/502] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:57 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1470 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:57.649896 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-af5120b9-70de-41aa-adb8-28c852978d28 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1874837392", "imageRef": "f2f37ffa-db20-478d-84c0-b429a987933c", "flavorRef": "452", "networks": [{"uuid": "a74a8470-0393-4315-802c-8d2ab5234a49"}]}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:57.708940 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=2 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:57.788492 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-af5120b9-70de-41aa-adb8-28c852978d28 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] validate_networks() for [('a74a8470-0393-4315-802c-8d2ab5234a49', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:58:58.028488 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=8 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:58.088850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a74b598c-0f0b-44d9-b35d-3c82c0fa3636 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:58.096905 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a74b598c-0f0b-44d9-b35d-3c82c0fa3636 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 0.514430 Jun 16 14:58:58.101119 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 251/503] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:57 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:58.106636 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a3705f01-bb44-41ad-9dfb-e322f24c0847 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:58.107372 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a3705f01-bb44-41ad-9dfb-e322f24c0847 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:58.109411 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:58.115177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a3705f01-bb44-41ad-9dfb-e322f24c0847 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:58.117907 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a3705f01-bb44-41ad-9dfb-e322f24c0847 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:58.118717 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a3705f01-bb44-41ad-9dfb-e322f24c0847 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:58.119167 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a3705f01-bb44-41ad-9dfb-e322f24c0847 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:58.383510 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a3705f01-bb44-41ad-9dfb-e322f24c0847 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:58.400772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a3705f01-bb44-41ad-9dfb-e322f24c0847 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1303 microversion: 2.1 time: 0.295002 Jun 16 14:58:58.417990 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 252/504] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:58 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1303 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:58.427369 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3d6fd405-3313-462f-8c3c-3ab32f3996e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:58.428326 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-3d6fd405-3313-462f-8c3c-3ab32f3996e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:58.442989 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3d6fd405-3313-462f-8c3c-3ab32f3996e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:58.443794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3d6fd405-3313-462f-8c3c-3ab32f3996e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:58.444826 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3d6fd405-3313-462f-8c3c-3ab32f3996e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:58.445462 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3d6fd405-3313-462f-8c3c-3ab32f3996e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:58.768032 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-af5120b9-70de-41aa-adb8-28c852978d28 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:58:58.769248 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-af5120b9-70de-41aa-adb8-28c852978d28 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:58:58.770370 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-af5120b9-70de-41aa-adb8-28c852978d28 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:58:58.771197 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-af5120b9-70de-41aa-adb8-28c852978d28 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:58:58.772084 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-af5120b9-70de-41aa-adb8-28c852978d28 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:58:58.794465 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-af5120b9-70de-41aa-adb8-28c852978d28 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:58.794958 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-af5120b9-70de-41aa-adb8-28c852978d28 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:58.802338 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-af5120b9-70de-41aa-adb8-28c852978d28 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:58.804049 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-af5120b9-70de-41aa-adb8-28c852978d28 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:58.835172 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-af5120b9-70de-41aa-adb8-28c852978d28 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Getting quotas for project cef1f9d9b1a74f84a3cdda0feb12ad0c. Resources: {'ram', 'cores', 'instances'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:58:58.839186 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3d6fd405-3313-462f-8c3c-3ab32f3996e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:58.841878 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-af5120b9-70de-41aa-adb8-28c852978d28 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Getting quotas for user 4b6c7f2af8fa4f68a80d006105a96ee3 and project cef1f9d9b1a74f84a3cdda0feb12ad0c. Resources: {'ram', 'cores', 'instances'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:58:58.854989 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3d6fd405-3313-462f-8c3c-3ab32f3996e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:58.856592 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3d6fd405-3313-462f-8c3c-3ab32f3996e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:58.857894 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3d6fd405-3313-462f-8c3c-3ab32f3996e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.436621 Jun 16 14:58:58.858463 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 253/505] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:58 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:58.861474 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:58.864979 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-af5120b9-70de-41aa-adb8-28c852978d28 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:58:58.867506 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-af5120b9-70de-41aa-adb8-28c852978d28 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2f37ffa-db20-478d-84c0-b429a987933c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:58:58.883410 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-13aeb966-960d-48ca-8e95-0109caea04d5 req-88c5d381-2551-45ba-8f77-b2cae4015f83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "120f403f-a9e1-4359-9e3b-6d3a98a5c7af", "name": "network-vif-plugged", "status": "completed", "tag": "b069c8fa-e747-4081-a398-e94c5755297b"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:58.908418 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-13aeb966-960d-48ca-8e95-0109caea04d5 req-88c5d381-2551-45ba-8f77-b2cae4015f83 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:58.909608 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-13aeb966-960d-48ca-8e95-0109caea04d5 req-88c5d381-2551-45ba-8f77-b2cae4015f83 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:58.942282 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-13aeb966-960d-48ca-8e95-0109caea04d5 req-88c5d381-2551-45ba-8f77-b2cae4015f83 service nova] Creating event network-vif-plugged:b069c8fa-e747-4081-a398-e94c5755297b for instance 120f403f-a9e1-4359-9e3b-6d3a98a5c7af on hv-cinder-83716 Jun 16 14:58:58.952163 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-13aeb966-960d-48ca-8e95-0109caea04d5 req-88c5d381-2551-45ba-8f77-b2cae4015f83 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071162 Jun 16 14:58:58.953568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 254/506] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:58:58.973673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-bde56f12-ed3a-496b-a323-c43b5de63195 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:58.974991 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-bde56f12-ed3a-496b-a323-c43b5de63195 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:58.982377 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bde56f12-ed3a-496b-a323-c43b5de63195 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:58.984071 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bde56f12-ed3a-496b-a323-c43b5de63195 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:58.985175 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bde56f12-ed3a-496b-a323-c43b5de63195 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:58.985986 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bde56f12-ed3a-496b-a323-c43b5de63195 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:58.998615 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR oslo.messaging._drivers.impl_rabbit [None req-af5120b9-70de-41aa-adb8-28c852978d28 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [9a6fcd8f-1eef-4c48-a93f-8a16be003b9c] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 14:58:59.736666 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-bde56f12-ed3a-496b-a323-c43b5de63195 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:59.758792 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-bde56f12-ed3a-496b-a323-c43b5de63195 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1470 microversion: 2.1 time: 0.803657 Jun 16 14:58:59.760104 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 255/507] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:58 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1470 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:59.768392 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-be8ff338-1e05-4de0-aaf6-7b5adb7d649c tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:59.769143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-be8ff338-1e05-4de0-aaf6-7b5adb7d649c tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:59.777441 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-be8ff338-1e05-4de0-aaf6-7b5adb7d649c tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:59.779469 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-be8ff338-1e05-4de0-aaf6-7b5adb7d649c tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:59.782485 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-be8ff338-1e05-4de0-aaf6-7b5adb7d649c tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:59.783141 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-be8ff338-1e05-4de0-aaf6-7b5adb7d649c tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:00.006446 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO oslo.messaging._drivers.impl_rabbit [None req-af5120b9-70de-41aa-adb8-28c852978d28 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [9a6fcd8f-1eef-4c48-a93f-8a16be003b9c] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 33582. Jun 16 14:59:00.015616 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-af5120b9-70de-41aa-adb8-28c852978d28 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.369405 Jun 16 14:59:00.016373 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 253/508] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 14:58:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 14:59:00.025782 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cf1f4afb-c0dc-470d-8193-408c6610c543 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:00.028955 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-cf1f4afb-c0dc-470d-8193-408c6610c543 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:00.039550 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cf1f4afb-c0dc-470d-8193-408c6610c543 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:00.040819 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cf1f4afb-c0dc-470d-8193-408c6610c543 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:00.042644 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cf1f4afb-c0dc-470d-8193-408c6610c543 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:00.043300 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cf1f4afb-c0dc-470d-8193-408c6610c543 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:00.144659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-be8ff338-1e05-4de0-aaf6-7b5adb7d649c tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:00.157232 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-be8ff338-1e05-4de0-aaf6-7b5adb7d649c tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1358 microversion: 2.1 time: 0.394140 Jun 16 14:59:00.163833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 256/509] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:59 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1358 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:00.168951 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e0e0c465-c762-4202-b187-6749e5f49c78 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:00.176425 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e0e0c465-c762-4202-b187-6749e5f49c78 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:00.190666 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e0e0c465-c762-4202-b187-6749e5f49c78 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:00.191992 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e0e0c465-c762-4202-b187-6749e5f49c78 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:00.192898 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e0e0c465-c762-4202-b187-6749e5f49c78 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:00.193327 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e0e0c465-c762-4202-b187-6749e5f49c78 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:00.213995 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cf1f4afb-c0dc-470d-8193-408c6610c543 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:00.244036 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-cf1f4afb-c0dc-470d-8193-408c6610c543 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1303 microversion: 2.1 time: 0.225405 Jun 16 14:59:00.259867 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 254/510] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:00 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1303 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:00.262988 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9c244046-49bd-4f08-99ed-c363c20cdd67 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:00.266017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9c244046-49bd-4f08-99ed-c363c20cdd67 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:00.470789 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9c244046-49bd-4f08-99ed-c363c20cdd67 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:00.498261 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9c244046-49bd-4f08-99ed-c363c20cdd67 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1219 microversion: 2.1 time: 0.246306 Jun 16 14:59:00.501667 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 255/511] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:00 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1219 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:00.506686 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-bb8f5c22-6908-4463-89b2-dc10fca0c53e req-cf5e4aca-9c79-4509-9267-023699c19e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57ad15bd-b09a-4896-97fd-86b4dc5cdab0", "name": "network-vif-deleted", "tag": "fad8a98c-0e41-4630-8105-a78c2c1e11d8"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:00.516671 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-bb8f5c22-6908-4463-89b2-dc10fca0c53e req-cf5e4aca-9c79-4509-9267-023699c19e9e service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:00.517120 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-bb8f5c22-6908-4463-89b2-dc10fca0c53e req-cf5e4aca-9c79-4509-9267-023699c19e9e service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:00.535013 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-bb8f5c22-6908-4463-89b2-dc10fca0c53e req-cf5e4aca-9c79-4509-9267-023699c19e9e service nova] Creating event network-vif-deleted:fad8a98c-0e41-4630-8105-a78c2c1e11d8 for instance 57ad15bd-b09a-4896-97fd-86b4dc5cdab0 on hv-cinder-83716 Jun 16 14:59:00.541783 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-bb8f5c22-6908-4463-89b2-dc10fca0c53e req-cf5e4aca-9c79-4509-9267-023699c19e9e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038209 Jun 16 14:59:00.543183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 256/512] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:59:00.608678 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e0e0c465-c762-4202-b187-6749e5f49c78 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:00.623885 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e0e0c465-c762-4202-b187-6749e5f49c78 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:00.626743 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e0e0c465-c762-4202-b187-6749e5f49c78 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:00.628574 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e0e0c465-c762-4202-b187-6749e5f49c78 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1740 microversion: 2.20 time: 0.463282 Jun 16 14:59:00.629778 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 257/513] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:00 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1740 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:00.792431 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d08a8028-37da-498f-9e3d-a4bf6b7bba47 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:00.793700 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d08a8028-37da-498f-9e3d-a4bf6b7bba47 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:00.807933 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d08a8028-37da-498f-9e3d-a4bf6b7bba47 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:00.808734 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d08a8028-37da-498f-9e3d-a4bf6b7bba47 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:00.809412 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d08a8028-37da-498f-9e3d-a4bf6b7bba47 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:00.810124 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d08a8028-37da-498f-9e3d-a4bf6b7bba47 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:00.878302 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d08a8028-37da-498f-9e3d-a4bf6b7bba47 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:00.878590 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d08a8028-37da-498f-9e3d-a4bf6b7bba47 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:00.878816 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-d08a8028-37da-498f-9e3d-a4bf6b7bba47 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lazy-loading 'fault' on Instance uuid 57ad15bd-b09a-4896-97fd-86b4dc5cdab0 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:59:00.936053 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d08a8028-37da-498f-9e3d-a4bf6b7bba47 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7237fbeb4fb64eecbef78b83974c09c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afad594036e64abf84514cb21e5f8d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:00.944160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d08a8028-37da-498f-9e3d-a4bf6b7bba47 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 200 len: 1304 microversion: 2.1 time: 0.169208 Jun 16 14:59:00.945092 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 257/514] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:00 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 1304 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:01.181628 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6b79d195-2635-4d1e-839a-282339696315 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:01.182904 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6b79d195-2635-4d1e-839a-282339696315 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:01.192339 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6b79d195-2635-4d1e-839a-282339696315 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:01.192852 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6b79d195-2635-4d1e-839a-282339696315 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:01.194406 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6b79d195-2635-4d1e-839a-282339696315 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:01.195083 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6b79d195-2635-4d1e-839a-282339696315 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:01.270935 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4242e7d4-2f08-4300-8aec-ef5d74a2504a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:01.272340 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4242e7d4-2f08-4300-8aec-ef5d74a2504a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:01.279969 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4242e7d4-2f08-4300-8aec-ef5d74a2504a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:01.280422 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4242e7d4-2f08-4300-8aec-ef5d74a2504a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:01.281200 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4242e7d4-2f08-4300-8aec-ef5d74a2504a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:01.282215 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4242e7d4-2f08-4300-8aec-ef5d74a2504a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:01.714471 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6b79d195-2635-4d1e-839a-282339696315 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:01.724768 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6b79d195-2635-4d1e-839a-282339696315 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1548 microversion: 2.1 time: 0.546923 Jun 16 14:59:01.725548 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 258/515] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:01 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1548 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:01.730378 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4673e0fc-5a78-4527-8b16-3fb6c39cb0f3 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:01.731439 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4673e0fc-5a78-4527-8b16-3fb6c39cb0f3 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:01.742187 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4673e0fc-5a78-4527-8b16-3fb6c39cb0f3 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:01.743027 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4673e0fc-5a78-4527-8b16-3fb6c39cb0f3 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:01.744022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4673e0fc-5a78-4527-8b16-3fb6c39cb0f3 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:01.744453 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4673e0fc-5a78-4527-8b16-3fb6c39cb0f3 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:01.770046 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4242e7d4-2f08-4300-8aec-ef5d74a2504a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:01.784760 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4242e7d4-2f08-4300-8aec-ef5d74a2504a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1370 microversion: 2.1 time: 0.517219 Jun 16 14:59:01.785945 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 258/516] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:01 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1370 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:01.792232 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-33973834-55a2-436c-8beb-dc5006d1f0c6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:01.793368 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-33973834-55a2-436c-8beb-dc5006d1f0c6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:01.802105 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-33973834-55a2-436c-8beb-dc5006d1f0c6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:01.802564 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-33973834-55a2-436c-8beb-dc5006d1f0c6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:01.803347 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-33973834-55a2-436c-8beb-dc5006d1f0c6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:01.803983 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-33973834-55a2-436c-8beb-dc5006d1f0c6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:01.808661 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:01.871655 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4673e0fc-5a78-4527-8b16-3fb6c39cb0f3 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:01.881261 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4673e0fc-5a78-4527-8b16-3fb6c39cb0f3 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1215 microversion: 2.1 time: 0.154444 Jun 16 14:59:01.882034 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 259/517] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:01 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1215 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:01.891849 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ca8addc1-6724-4e97-8080-cd5b1656ecd8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:01.892839 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ca8addc1-6724-4e97-8080-cd5b1656ecd8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:01.900344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ca8addc1-6724-4e97-8080-cd5b1656ecd8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:01.900883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ca8addc1-6724-4e97-8080-cd5b1656ecd8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:01.901894 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ca8addc1-6724-4e97-8080-cd5b1656ecd8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:01.902521 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ca8addc1-6724-4e97-8080-cd5b1656ecd8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:02.289605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-33973834-55a2-436c-8beb-dc5006d1f0c6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:02.305868 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-33973834-55a2-436c-8beb-dc5006d1f0c6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:02.308810 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-33973834-55a2-436c-8beb-dc5006d1f0c6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:02.313702 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-33973834-55a2-436c-8beb-dc5006d1f0c6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1722 microversion: 2.20 time: 0.525820 Jun 16 14:59:02.315292 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 259/518] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:01 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1722 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:02.320335 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d1307031-3048-4317-b9fa-9114e7a88769 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:02.320942 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d1307031-3048-4317-b9fa-9114e7a88769 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] [instance: 57ad15bd-b09a-4896-97fd-86b4dc5cdab0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:02.330882 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d1307031-3048-4317-b9fa-9114e7a88769 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:02.331323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d1307031-3048-4317-b9fa-9114e7a88769 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:02.332538 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d1307031-3048-4317-b9fa-9114e7a88769 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:02.333358 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d1307031-3048-4317-b9fa-9114e7a88769 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:02.334708 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ca8addc1-6724-4e97-8080-cd5b1656ecd8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:02.348309 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ca8addc1-6724-4e97-8080-cd5b1656ecd8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1548 microversion: 2.1 time: 0.464922 Jun 16 14:59:02.349468 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 260/519] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:01 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1548 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:02.362379 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-d1307031-3048-4317-b9fa-9114e7a88769 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] HTTP exception thrown: Instance 57ad15bd-b09a-4896-97fd-86b4dc5cdab0 could not be found. Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d1307031-3048-4317-b9fa-9114e7a88769 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Request method failure captured: Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 HTTP/1.1 Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0UBLUqxtU2W1Z2aulZcMbSzEAyV6C6zWHdbFalfTLl-l6drB7cG1P97H0toF_O2yNibrNR6rlhR6xjCDmXXAPzXPDzSZcnhX0aLa5SIZ18vZDIAB_TlDDnt1bv-noquCp4uH7BLGeA61_jetBDrJ_MD1RkbLIYAkbRMV9OJTlgTD4w Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: afad594036e64abf84514cb21e5f8d75 Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-VolumesNegativeTest-860293672 Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 14:59:02.366028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 14:59:02.367399 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/afad594036e64abf84514cb21e5f8d75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/afad594036e64abf84514cb21e5f8d75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_afad594036e64abf84514cb21e5f8d75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/afad594036e64abf84514cb21e5f8d75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:59:02.367399 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-VolumesNegativeTest-860293672 Jun 16 14:59:02.367399 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: afad594036e64abf84514cb21e5f8d75 Jun 16 14:59:02.367399 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-VolumesNegativeTest-860293672 Jun 16 14:59:02.367399 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-VolumesNegativeTest-860293672-project Jun 16 14:59:02.367399 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 14:59:02.367399 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 14:59:02.367399 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 7237fbeb4fb64eecbef78b83974c09c8 Jun 16 14:59:02.367399 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-VolumesNegativeTest-860293672-project Jun 16 14:59:02.367399 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 14:59:02.367399 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance 57ad15bd-b09a-4896-97fd-86b4dc5cdab0 could not be found. Jun 16 14:59:02.367399 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': '57ad15bd-b09a-4896-97fd-86b4dc5cdab0'} Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57ad15bd-b09a-4896-97fd-86b4dc5cdab0 could not be found. Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:59:02.368160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:59:02.369326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:59:02.369326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:59:02.369326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:59:02.369326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:59:02.369326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:59:02.369326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:59:02.369326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:59:02.369326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57ad15bd-b09a-4896-97fd-86b4dc5cdab0 could not be found. Jun 16 14:59:02.369326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:59:02.369326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:59:02.369326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:59:02.369326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:02.369326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:59:02.369326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:59:02.369326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:59:02.369326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:59:02.369326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57ad15bd-b09a-4896-97fd-86b4dc5cdab0 could not be found. Jun 16 14:59:02.369326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:59:02.370446 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d1307031-3048-4317-b9fa-9114e7a88769 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] Returning 404 to user: Instance 57ad15bd-b09a-4896-97fd-86b4dc5cdab0 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:59:02.370446 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d1307031-3048-4317-b9fa-9114e7a88769 tempest-VolumesNegativeTest-860293672 tempest-VolumesNegativeTest-860293672-project] 10.222.0.76 "GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0" status: 404 len: 111 microversion: 2.1 time: 0.051331 Jun 16 14:59:02.370585 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1f7b0bfd-e88f-4d42-82bf-f6ea775af974 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:02.372403 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1f7b0bfd-e88f-4d42-82bf-f6ea775af974 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:02.374311 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-1f7b0bfd-e88f-4d42-82bf-f6ea775af974 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Searching by: {'deleted': False, 'project_id': '1b370efdc42b4a998a42230123901514'} {{(pid=117443) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:59:02.374977 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 260/520] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:02 2022] GET /compute/v2.1/servers/57ad15bd-b09a-4896-97fd-86b4dc5cdab0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:59:02.413553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1f7b0bfd-e88f-4d42-82bf-f6ea775af974 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:02.413881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1f7b0bfd-e88f-4d42-82bf-f6ea775af974 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:02.416601 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1f7b0bfd-e88f-4d42-82bf-f6ea775af974 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:02.425021 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1f7b0bfd-e88f-4d42-82bf-f6ea775af974 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:02.479385 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-8a660d53-9cfc-495b-ad64-e2752c58532d req-21f79aea-4acf-46c1-8043-bf54ea4155ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663488be-459f-4a58-aa1c-82be04813a2f", "name": "network-vif-unplugged", "status": "completed", "tag": "5508bdf2-993b-44f0-8926-4159b1e31b1d"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:02.510779 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-8a660d53-9cfc-495b-ad64-e2752c58532d req-21f79aea-4acf-46c1-8043-bf54ea4155ab service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:02.514525 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-8a660d53-9cfc-495b-ad64-e2752c58532d req-21f79aea-4acf-46c1-8043-bf54ea4155ab service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:02.544416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-8a660d53-9cfc-495b-ad64-e2752c58532d req-21f79aea-4acf-46c1-8043-bf54ea4155ab service nova] Creating event network-vif-unplugged:5508bdf2-993b-44f0-8926-4159b1e31b1d for instance 663488be-459f-4a58-aa1c-82be04813a2f on hv-cinder-83716 Jun 16 14:59:02.564505 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-8a660d53-9cfc-495b-ad64-e2752c58532d req-21f79aea-4acf-46c1-8043-bf54ea4155ab service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088627 Jun 16 14:59:02.565749 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 261/521] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:59:02.635502 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.multi_cell_list [None req-1f7b0bfd-e88f-4d42-82bf-f6ea775af974 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117443) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 14:59:02.819322 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-124893c5-5a76-439c-82c4-7580126cb0b3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:02.820520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-124893c5-5a76-439c-82c4-7580126cb0b3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:02.850790 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-124893c5-5a76-439c-82c4-7580126cb0b3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:02.862380 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-124893c5-5a76-439c-82c4-7580126cb0b3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:02.863546 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-124893c5-5a76-439c-82c4-7580126cb0b3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:02.864064 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-124893c5-5a76-439c-82c4-7580126cb0b3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:03.066919 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1f7b0bfd-e88f-4d42-82bf-f6ea775af974 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.702454 Jun 16 14:59:03.067735 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 261/522] 10.222.0.76 () {58 vars in 1124 bytes} [Thu Jun 16 14:59:02 2022] GET /compute/v2.1/servers => generated 342 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:59:03.075868 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-5bb25a9c-5d7d-4b91-814a-8223f801c1dd tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:03.076666 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-5bb25a9c-5d7d-4b91-814a-8223f801c1dd tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:03.089674 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5bb25a9c-5d7d-4b91-814a-8223f801c1dd tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:03.092282 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5bb25a9c-5d7d-4b91-814a-8223f801c1dd tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:03.093235 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5bb25a9c-5d7d-4b91-814a-8223f801c1dd tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:03.093790 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5bb25a9c-5d7d-4b91-814a-8223f801c1dd tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:03.279132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-5bb25a9c-5d7d-4b91-814a-8223f801c1dd tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:03.281758 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-124893c5-5a76-439c-82c4-7580126cb0b3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:03.294654 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-5bb25a9c-5d7d-4b91-814a-8223f801c1dd tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1277 microversion: 2.1 time: 0.225374 Jun 16 14:59:03.305096 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 262/523] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:03 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:03.305096 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-b6cee716-b4d7-42b4-8ccf-7a54d52eee68 req-c182bfe3-674e-4546-96ae-5ebc8667db2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b469ddcc-e9b1-4c39-9c75-3b98f6f624c3", "tag": "4ac5eb81-f7f2-453f-a4f4-fba5e3e3d8d9"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:03.316288 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-124893c5-5a76-439c-82c4-7580126cb0b3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1370 microversion: 2.1 time: 0.512092 Jun 16 14:59:03.317294 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 262/524] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:02 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1370 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:03.321187 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-b6cee716-b4d7-42b4-8ccf-7a54d52eee68 req-c182bfe3-674e-4546-96ae-5ebc8667db2c service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:03.321883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-b6cee716-b4d7-42b4-8ccf-7a54d52eee68 req-c182bfe3-674e-4546-96ae-5ebc8667db2c service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:03.322932 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-04bcb906-dd27-4112-84fd-d7ad7755b873 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:03.324050 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-04bcb906-dd27-4112-84fd-d7ad7755b873 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:03.334188 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-04bcb906-dd27-4112-84fd-d7ad7755b873 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:03.335216 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-04bcb906-dd27-4112-84fd-d7ad7755b873 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:03.336297 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-04bcb906-dd27-4112-84fd-d7ad7755b873 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:03.337000 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-04bcb906-dd27-4112-84fd-d7ad7755b873 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:03.339673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-b6cee716-b4d7-42b4-8ccf-7a54d52eee68 req-c182bfe3-674e-4546-96ae-5ebc8667db2c service nova] Creating event network-changed:4ac5eb81-f7f2-453f-a4f4-fba5e3e3d8d9 for instance b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 on hv-cinder-83716 Jun 16 14:59:03.348135 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-b6cee716-b4d7-42b4-8ccf-7a54d52eee68 req-c182bfe3-674e-4546-96ae-5ebc8667db2c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049496 Jun 16 14:59:03.349144 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 263/525] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:59:03.360058 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-697a71f0-b808-4254-9b04-bf291021613d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:03.361005 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-697a71f0-b808-4254-9b04-bf291021613d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:03.369177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-697a71f0-b808-4254-9b04-bf291021613d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:03.370101 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-697a71f0-b808-4254-9b04-bf291021613d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:03.371398 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-697a71f0-b808-4254-9b04-bf291021613d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:03.372252 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-697a71f0-b808-4254-9b04-bf291021613d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:03.725535 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 14:59:03.726185 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Thu Jun 16 14:59:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af (ip 10.222.0.76) !!! Jun 16 14:59:03.790207 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-697a71f0-b808-4254-9b04-bf291021613d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:03.800909 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=100 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:03.809801 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-697a71f0-b808-4254-9b04-bf291021613d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:03.810791 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-04bcb906-dd27-4112-84fd-d7ad7755b873 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:03.813579 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-697a71f0-b808-4254-9b04-bf291021613d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:03.820727 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-697a71f0-b808-4254-9b04-bf291021613d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1722 microversion: 2.20 time: 0.470081 Jun 16 14:59:03.821460 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 264/526] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:03 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1722 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:03.823389 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-04bcb906-dd27-4112-84fd-d7ad7755b873 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1548 microversion: 2.1 time: 0.503815 Jun 16 14:59:03.824037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 263/527] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:03 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1548 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:04.314339 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6dee3f46-08a3-424d-9875-337a39c712aa tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:04.320245 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6dee3f46-08a3-424d-9875-337a39c712aa tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:04.327527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6dee3f46-08a3-424d-9875-337a39c712aa tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:04.328045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6dee3f46-08a3-424d-9875-337a39c712aa tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:04.328844 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6dee3f46-08a3-424d-9875-337a39c712aa tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:04.329408 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6dee3f46-08a3-424d-9875-337a39c712aa tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:04.338052 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d2cf9449-057a-4aa6-babf-d1c5a05e33d5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:04.338834 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d2cf9449-057a-4aa6-babf-d1c5a05e33d5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:04.347409 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d2cf9449-057a-4aa6-babf-d1c5a05e33d5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:04.347903 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d2cf9449-057a-4aa6-babf-d1c5a05e33d5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:04.349204 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d2cf9449-057a-4aa6-babf-d1c5a05e33d5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:04.349204 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d2cf9449-057a-4aa6-babf-d1c5a05e33d5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:04.566254 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6dee3f46-08a3-424d-9875-337a39c712aa tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:04.575511 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6dee3f46-08a3-424d-9875-337a39c712aa tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1319 microversion: 2.1 time: 0.266928 Jun 16 14:59:04.576824 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 265/528] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:04 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:04.580841 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d2cf9449-057a-4aa6-babf-d1c5a05e33d5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:04.590958 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d2cf9449-057a-4aa6-babf-d1c5a05e33d5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1370 microversion: 2.1 time: 0.258879 Jun 16 14:59:04.592334 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 264/529] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:04 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:04.850367 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-0db17b6a-9c60-41b0-bc8f-e2008e2d8cc6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:04.851148 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-0db17b6a-9c60-41b0-bc8f-e2008e2d8cc6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:04.858082 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0db17b6a-9c60-41b0-bc8f-e2008e2d8cc6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:04.858526 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0db17b6a-9c60-41b0-bc8f-e2008e2d8cc6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:04.859282 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0db17b6a-9c60-41b0-bc8f-e2008e2d8cc6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:04.859723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0db17b6a-9c60-41b0-bc8f-e2008e2d8cc6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:05.055403 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-0db17b6a-9c60-41b0-bc8f-e2008e2d8cc6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:05.069095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-0db17b6a-9c60-41b0-bc8f-e2008e2d8cc6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:05.070794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-0db17b6a-9c60-41b0-bc8f-e2008e2d8cc6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:05.072620 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-0db17b6a-9c60-41b0-bc8f-e2008e2d8cc6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1722 microversion: 2.20 time: 0.227174 Jun 16 14:59:05.073199 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 266/530] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:04 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:05.495485 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e485ac59-1c25-4a93-8852-58210bab70a8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb17dbbc-97ae-45d6-9230-392115091e69"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:05.497836 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e485ac59-1c25-4a93-8852-58210bab70a8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:05.506853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e485ac59-1c25-4a93-8852-58210bab70a8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:05.508045 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e485ac59-1c25-4a93-8852-58210bab70a8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:05.508985 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e485ac59-1c25-4a93-8852-58210bab70a8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:05.509948 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e485ac59-1c25-4a93-8852-58210bab70a8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:05.597227 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-980be4b7-e3ae-40c3-abce-19b89d77785c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:05.597951 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-980be4b7-e3ae-40c3-abce-19b89d77785c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:05.607868 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-980be4b7-e3ae-40c3-abce-19b89d77785c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:05.609677 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-980be4b7-e3ae-40c3-abce-19b89d77785c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:05.610487 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-980be4b7-e3ae-40c3-abce-19b89d77785c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:05.611173 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-980be4b7-e3ae-40c3-abce-19b89d77785c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:05.937319 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-980be4b7-e3ae-40c3-abce-19b89d77785c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:05.945996 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-980be4b7-e3ae-40c3-abce-19b89d77785c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1319 microversion: 2.1 time: 0.356958 Jun 16 14:59:05.948783 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 267/531] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:05 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:05.953702 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1d8da93d-12a1-4def-b6f0-16ba2251dd09 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:05.954293 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-1d8da93d-12a1-4def-b6f0-16ba2251dd09 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:05.986864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1d8da93d-12a1-4def-b6f0-16ba2251dd09 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:05.987267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1d8da93d-12a1-4def-b6f0-16ba2251dd09 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:05.988931 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1d8da93d-12a1-4def-b6f0-16ba2251dd09 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:05.989657 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1d8da93d-12a1-4def-b6f0-16ba2251dd09 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:06.121718 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e485ac59-1c25-4a93-8852-58210bab70a8 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "POST /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.632170 Jun 16 14:59:06.123829 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 265/532] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Jun 16 14:59:05 2022] POST /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/os-volume_attachments => generated 194 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:59:06.157504 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-059a08ce-96a5-4a39-afc8-1060796ff518 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:06.159537 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-059a08ce-96a5-4a39-afc8-1060796ff518 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:06.178647 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-059a08ce-96a5-4a39-afc8-1060796ff518 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:06.182067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-059a08ce-96a5-4a39-afc8-1060796ff518 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:06.183644 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-059a08ce-96a5-4a39-afc8-1060796ff518 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:06.186766 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-059a08ce-96a5-4a39-afc8-1060796ff518 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:06.883754 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-059a08ce-96a5-4a39-afc8-1060796ff518 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:06.899085 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1d8da93d-12a1-4def-b6f0-16ba2251dd09 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:06.903671 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-059a08ce-96a5-4a39-afc8-1060796ff518 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:06.908814 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-059a08ce-96a5-4a39-afc8-1060796ff518 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:06.910223 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-059a08ce-96a5-4a39-afc8-1060796ff518 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1725 microversion: 2.20 time: 0.784836 Jun 16 14:59:06.910827 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 266/533] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:06 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1725 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:06.914434 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1d8da93d-12a1-4def-b6f0-16ba2251dd09 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1370 microversion: 2.1 time: 0.964373 Jun 16 14:59:06.915124 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 268/534] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:05 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1370 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:06.915936 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-4f79b6c8-07c4-47cd-99d1-3764586f12eb req-b1f748ce-4c65-42c9-b5fd-f0e97f68971c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14563c3c-bdd4-46f1-890f-bf0aa3045d69", "tag": "7423e547-f966-4e2a-8d0c-a9f36a726ddf"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:06.930492 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-4f79b6c8-07c4-47cd-99d1-3764586f12eb req-b1f748ce-4c65-42c9-b5fd-f0e97f68971c service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:06.931151 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-4f79b6c8-07c4-47cd-99d1-3764586f12eb req-b1f748ce-4c65-42c9-b5fd-f0e97f68971c service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:06.932325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a8585b55-b39d-4299-b5d9-de4b32ad1e92 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "768dbc99-5f47-4394-a3e1-fbe939ee3a17"}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:06.933599 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a8585b55-b39d-4299-b5d9-de4b32ad1e92 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:06.942445 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a8585b55-b39d-4299-b5d9-de4b32ad1e92 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:06.943144 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a8585b55-b39d-4299-b5d9-de4b32ad1e92 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:06.944606 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-4f79b6c8-07c4-47cd-99d1-3764586f12eb req-b1f748ce-4c65-42c9-b5fd-f0e97f68971c service nova] Creating event network-changed:7423e547-f966-4e2a-8d0c-a9f36a726ddf for instance 14563c3c-bdd4-46f1-890f-bf0aa3045d69 on hv-cinder-83716 Jun 16 14:59:06.944842 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a8585b55-b39d-4299-b5d9-de4b32ad1e92 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:06.945296 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a8585b55-b39d-4299-b5d9-de4b32ad1e92 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:06.951322 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-4f79b6c8-07c4-47cd-99d1-3764586f12eb req-b1f748ce-4c65-42c9-b5fd-f0e97f68971c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037635 Jun 16 14:59:06.952166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 267/535] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:59:06.972297 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-30ed40ff-a5a8-4824-b2ce-0038224bab24 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:06.973021 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-30ed40ff-a5a8-4824-b2ce-0038224bab24 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:06.979401 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-30ed40ff-a5a8-4824-b2ce-0038224bab24 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:06.979885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-30ed40ff-a5a8-4824-b2ce-0038224bab24 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:06.980653 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-30ed40ff-a5a8-4824-b2ce-0038224bab24 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:06.981086 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-30ed40ff-a5a8-4824-b2ce-0038224bab24 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:07.148599 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-30ed40ff-a5a8-4824-b2ce-0038224bab24 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:07.156303 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-30ed40ff-a5a8-4824-b2ce-0038224bab24 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1319 microversion: 2.1 time: 0.188161 Jun 16 14:59:07.157127 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 268/536] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:06 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:07.358787 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a8585b55-b39d-4299-b5d9-de4b32ad1e92 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "POST /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.431937 Jun 16 14:59:07.365433 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 269/537] 10.222.0.76 () {62 vars in 1363 bytes} [Thu Jun 16 14:59:06 2022] POST /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/os-volume_attachments => generated 188 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:59:07.491805 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2489fd44-92a7-4c3a-a5c5-ea689c1f316d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:07.492383 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2489fd44-92a7-4c3a-a5c5-ea689c1f316d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:07.499031 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2489fd44-92a7-4c3a-a5c5-ea689c1f316d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:07.499895 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2489fd44-92a7-4c3a-a5c5-ea689c1f316d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:07.501156 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2489fd44-92a7-4c3a-a5c5-ea689c1f316d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:07.501918 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2489fd44-92a7-4c3a-a5c5-ea689c1f316d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:07.618390 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2489fd44-92a7-4c3a-a5c5-ea689c1f316d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "POST /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/action" status: 202 len: 0 microversion: 2.20 time: 0.130600 Jun 16 14:59:07.619277 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 269/538] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Jun 16 14:59:07 2022] POST /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:59:07.629357 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-be30357a-aa5f-4c57-a332-c1999e958cc5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:07.630188 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-be30357a-aa5f-4c57-a332-c1999e958cc5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:07.639560 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-be30357a-aa5f-4c57-a332-c1999e958cc5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:07.640114 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-be30357a-aa5f-4c57-a332-c1999e958cc5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:07.640878 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-be30357a-aa5f-4c57-a332-c1999e958cc5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:07.641334 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-be30357a-aa5f-4c57-a332-c1999e958cc5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:07.844203 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-be30357a-aa5f-4c57-a332-c1999e958cc5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:07.853115 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-be30357a-aa5f-4c57-a332-c1999e958cc5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:07.854657 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-be30357a-aa5f-4c57-a332-c1999e958cc5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:07.855936 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-be30357a-aa5f-4c57-a332-c1999e958cc5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1751 microversion: 2.20 time: 0.230737 Jun 16 14:59:07.856500 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 270/539] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:07 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1751 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:07.939514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3fd0b0ff-a27c-4fe0-9904-d22c7c26bafd tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:07.940552 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3fd0b0ff-a27c-4fe0-9904-d22c7c26bafd tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:07.947344 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3fd0b0ff-a27c-4fe0-9904-d22c7c26bafd tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:07.948084 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3fd0b0ff-a27c-4fe0-9904-d22c7c26bafd tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:07.949045 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3fd0b0ff-a27c-4fe0-9904-d22c7c26bafd tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:07.949634 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3fd0b0ff-a27c-4fe0-9904-d22c7c26bafd tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:08.181815 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ca7d4132-240d-4d36-bdd5-c7b6a6183012 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:08.183004 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ca7d4132-240d-4d36-bdd5-c7b6a6183012 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:08.213413 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ca7d4132-240d-4d36-bdd5-c7b6a6183012 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:08.213987 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ca7d4132-240d-4d36-bdd5-c7b6a6183012 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:08.223478 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ca7d4132-240d-4d36-bdd5-c7b6a6183012 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:08.224496 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ca7d4132-240d-4d36-bdd5-c7b6a6183012 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:08.237861 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3fd0b0ff-a27c-4fe0-9904-d22c7c26bafd tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:08.249405 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3fd0b0ff-a27c-4fe0-9904-d22c7c26bafd tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1370 microversion: 2.1 time: 0.315354 Jun 16 14:59:08.250787 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 270/540] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:07 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1370 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:08.594676 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ca7d4132-240d-4d36-bdd5-c7b6a6183012 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:08.631536 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ca7d4132-240d-4d36-bdd5-c7b6a6183012 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1319 microversion: 2.1 time: 0.460206 Jun 16 14:59:08.647796 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 271/541] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:08 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:08.875535 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-fa18e148-dee9-4265-9fbe-39f16573ddbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:08.876630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-fa18e148-dee9-4265-9fbe-39f16573ddbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:08.881034 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:08.885262 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fa18e148-dee9-4265-9fbe-39f16573ddbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:08.885840 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fa18e148-dee9-4265-9fbe-39f16573ddbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:08.886810 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fa18e148-dee9-4265-9fbe-39f16573ddbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:08.887396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fa18e148-dee9-4265-9fbe-39f16573ddbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:09.062220 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fa18e148-dee9-4265-9fbe-39f16573ddbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:09.072306 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fa18e148-dee9-4265-9fbe-39f16573ddbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:09.073816 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fa18e148-dee9-4265-9fbe-39f16573ddbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:09.075020 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-fa18e148-dee9-4265-9fbe-39f16573ddbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1751 microversion: 2.20 time: 0.204093 Jun 16 14:59:09.076942 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 271/542] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:08 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1751 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:09.268903 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3bf5c3bd-654f-44a8-9c2b-0db5e7db5a84 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:09.269614 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-3bf5c3bd-654f-44a8-9c2b-0db5e7db5a84 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:09.286952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3bf5c3bd-654f-44a8-9c2b-0db5e7db5a84 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:09.287402 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3bf5c3bd-654f-44a8-9c2b-0db5e7db5a84 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:09.288213 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3bf5c3bd-654f-44a8-9c2b-0db5e7db5a84 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:09.288644 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3bf5c3bd-654f-44a8-9c2b-0db5e7db5a84 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:09.479445 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3bf5c3bd-654f-44a8-9c2b-0db5e7db5a84 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:09.488080 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3bf5c3bd-654f-44a8-9c2b-0db5e7db5a84 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1370 microversion: 2.1 time: 0.223888 Jun 16 14:59:09.488662 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 272/543] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:09 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:09.659431 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-88076f57-0bfb-4474-a2fb-2a5cacf270af tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:09.660074 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-88076f57-0bfb-4474-a2fb-2a5cacf270af tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:09.667538 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-88076f57-0bfb-4474-a2fb-2a5cacf270af tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:09.668446 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-88076f57-0bfb-4474-a2fb-2a5cacf270af tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:09.669424 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-88076f57-0bfb-4474-a2fb-2a5cacf270af tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:09.670682 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-88076f57-0bfb-4474-a2fb-2a5cacf270af tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:09.834689 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-88076f57-0bfb-4474-a2fb-2a5cacf270af tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:09.847057 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-88076f57-0bfb-4474-a2fb-2a5cacf270af tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1319 microversion: 2.1 time: 0.191916 Jun 16 14:59:09.857820 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 272/544] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:09 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:10.096344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-51619869-220b-4c68-a397-7d2c21c3d32c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:10.096953 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-51619869-220b-4c68-a397-7d2c21c3d32c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:10.104886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-51619869-220b-4c68-a397-7d2c21c3d32c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:10.105706 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-51619869-220b-4c68-a397-7d2c21c3d32c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:10.106713 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-51619869-220b-4c68-a397-7d2c21c3d32c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:10.107242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-51619869-220b-4c68-a397-7d2c21c3d32c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:10.299026 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-51619869-220b-4c68-a397-7d2c21c3d32c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:10.309809 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-51619869-220b-4c68-a397-7d2c21c3d32c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:10.312091 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-51619869-220b-4c68-a397-7d2c21c3d32c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:10.313185 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-51619869-220b-4c68-a397-7d2c21c3d32c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1753 microversion: 2.20 time: 0.221899 Jun 16 14:59:10.313793 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 273/545] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:10 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1753 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:10.506259 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ffff9fb0-3f55-457d-915b-ae2a00877812 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:10.507875 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ffff9fb0-3f55-457d-915b-ae2a00877812 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:10.511584 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=8 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:10.519035 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ffff9fb0-3f55-457d-915b-ae2a00877812 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:10.519658 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ffff9fb0-3f55-457d-915b-ae2a00877812 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:10.520603 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ffff9fb0-3f55-457d-915b-ae2a00877812 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:10.521425 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ffff9fb0-3f55-457d-915b-ae2a00877812 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:10.711521 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ffff9fb0-3f55-457d-915b-ae2a00877812 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:10.722330 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ffff9fb0-3f55-457d-915b-ae2a00877812 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1370 microversion: 2.1 time: 0.220763 Jun 16 14:59:10.727132 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 273/546] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:10 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:10.864994 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-94e53da7-df3b-4c58-8556-1354046c85c8 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:10.865937 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-94e53da7-df3b-4c58-8556-1354046c85c8 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:10.873551 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-94e53da7-df3b-4c58-8556-1354046c85c8 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:10.873960 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-94e53da7-df3b-4c58-8556-1354046c85c8 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:10.874737 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-94e53da7-df3b-4c58-8556-1354046c85c8 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:10.875172 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-94e53da7-df3b-4c58-8556-1354046c85c8 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:11.127357 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-94e53da7-df3b-4c58-8556-1354046c85c8 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:11.136264 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-94e53da7-df3b-4c58-8556-1354046c85c8 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1319 microversion: 2.1 time: 0.275542 Jun 16 14:59:11.137226 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 274/547] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:10 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:11.334509 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7d326ef0-8ed8-4457-a208-5e3913212e3f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:11.335374 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7d326ef0-8ed8-4457-a208-5e3913212e3f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:11.344814 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7d326ef0-8ed8-4457-a208-5e3913212e3f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:11.345635 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7d326ef0-8ed8-4457-a208-5e3913212e3f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:11.346782 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7d326ef0-8ed8-4457-a208-5e3913212e3f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:11.347390 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7d326ef0-8ed8-4457-a208-5e3913212e3f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:11.548475 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7d326ef0-8ed8-4457-a208-5e3913212e3f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:11.559655 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7d326ef0-8ed8-4457-a208-5e3913212e3f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:11.562000 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7d326ef0-8ed8-4457-a208-5e3913212e3f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:11.563916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7d326ef0-8ed8-4457-a208-5e3913212e3f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1753 microversion: 2.20 time: 0.234749 Jun 16 14:59:11.565107 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 274/548] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:11 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1753 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:11.753140 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f0e1d174-5390-48dc-81bc-be5d5a76f604 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:11.754383 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f0e1d174-5390-48dc-81bc-be5d5a76f604 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:11.762855 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f0e1d174-5390-48dc-81bc-be5d5a76f604 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:11.764005 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f0e1d174-5390-48dc-81bc-be5d5a76f604 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:11.765406 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f0e1d174-5390-48dc-81bc-be5d5a76f604 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:11.766502 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f0e1d174-5390-48dc-81bc-be5d5a76f604 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:11.994749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f0e1d174-5390-48dc-81bc-be5d5a76f604 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:12.007094 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f0e1d174-5390-48dc-81bc-be5d5a76f604 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1370 microversion: 2.1 time: 0.270361 Jun 16 14:59:12.007945 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 275/549] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:11 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1370 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:12.154107 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-86da53dc-84ce-4c6e-b33f-6dbcc902fb9e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:12.155311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-86da53dc-84ce-4c6e-b33f-6dbcc902fb9e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:12.165016 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-86da53dc-84ce-4c6e-b33f-6dbcc902fb9e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:12.167114 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-86da53dc-84ce-4c6e-b33f-6dbcc902fb9e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:12.169254 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-86da53dc-84ce-4c6e-b33f-6dbcc902fb9e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:12.170650 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-86da53dc-84ce-4c6e-b33f-6dbcc902fb9e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:12.197858 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:12.361421 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-86da53dc-84ce-4c6e-b33f-6dbcc902fb9e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:12.370066 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-86da53dc-84ce-4c6e-b33f-6dbcc902fb9e tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1319 microversion: 2.1 time: 0.220136 Jun 16 14:59:12.370744 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 275/550] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:12 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:12.599123 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-5f0ed67b-7b90-4c14-93cd-b868b1753c32 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:12.600214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-5f0ed67b-7b90-4c14-93cd-b868b1753c32 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:12.617044 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=2 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:12.624051 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5f0ed67b-7b90-4c14-93cd-b868b1753c32 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:12.624709 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5f0ed67b-7b90-4c14-93cd-b868b1753c32 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:12.626405 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5f0ed67b-7b90-4c14-93cd-b868b1753c32 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:12.628616 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5f0ed67b-7b90-4c14-93cd-b868b1753c32 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:12.859512 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-5f0ed67b-7b90-4c14-93cd-b868b1753c32 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:12.868661 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-b0a349f0-f1f0-41e8-a5ac-02d3dda02c33 req-4f439185-1e14-4d04-91d4-3a542826f0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b469ddcc-e9b1-4c39-9c75-3b98f6f624c3", "name": "network-vif-plugged", "status": "completed", "tag": "4ac5eb81-f7f2-453f-a4f4-fba5e3e3d8d9"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:12.871171 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-5f0ed67b-7b90-4c14-93cd-b868b1753c32 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:12.872838 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-5f0ed67b-7b90-4c14-93cd-b868b1753c32 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:12.874132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-5f0ed67b-7b90-4c14-93cd-b868b1753c32 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1753 microversion: 2.20 time: 0.287936 Jun 16 14:59:12.874732 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 276/551] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:12 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1753 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:12.913995 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-b0a349f0-f1f0-41e8-a5ac-02d3dda02c33 req-4f439185-1e14-4d04-91d4-3a542826f0e1 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:12.915669 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-b0a349f0-f1f0-41e8-a5ac-02d3dda02c33 req-4f439185-1e14-4d04-91d4-3a542826f0e1 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:12.953604 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-b0a349f0-f1f0-41e8-a5ac-02d3dda02c33 req-4f439185-1e14-4d04-91d4-3a542826f0e1 service nova] Creating event network-vif-plugged:4ac5eb81-f7f2-453f-a4f4-fba5e3e3d8d9 for instance b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 on hv-cinder-83716 Jun 16 14:59:12.960005 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-b0a349f0-f1f0-41e8-a5ac-02d3dda02c33 req-4f439185-1e14-4d04-91d4-3a542826f0e1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100482 Jun 16 14:59:12.961450 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 276/552] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:59:13.047361 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-2f4e5a31-d389-4bcd-8ffd-6f0d505f688d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:13.057354 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-2f4e5a31-d389-4bcd-8ffd-6f0d505f688d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:13.076484 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2f4e5a31-d389-4bcd-8ffd-6f0d505f688d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:13.077280 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2f4e5a31-d389-4bcd-8ffd-6f0d505f688d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:13.078722 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2f4e5a31-d389-4bcd-8ffd-6f0d505f688d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:13.079523 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2f4e5a31-d389-4bcd-8ffd-6f0d505f688d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:13.258769 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2f4e5a31-d389-4bcd-8ffd-6f0d505f688d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:13.267160 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-2f4e5a31-d389-4bcd-8ffd-6f0d505f688d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1370 microversion: 2.1 time: 0.231634 Jun 16 14:59:13.268176 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 277/553] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:13 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1370 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:13.395803 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-17a775a4-f492-47a6-bb90-b4b8220a0620 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:13.396643 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-17a775a4-f492-47a6-bb90-b4b8220a0620 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:13.404384 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-17a775a4-f492-47a6-bb90-b4b8220a0620 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:13.405001 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-17a775a4-f492-47a6-bb90-b4b8220a0620 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:13.405865 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-17a775a4-f492-47a6-bb90-b4b8220a0620 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:13.406368 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-17a775a4-f492-47a6-bb90-b4b8220a0620 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:13.689925 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-17a775a4-f492-47a6-bb90-b4b8220a0620 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:13.728953 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-17a775a4-f492-47a6-bb90-b4b8220a0620 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1319 microversion: 2.1 time: 0.335401 Jun 16 14:59:13.736609 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 277/554] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:13 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:13.897227 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a80985cf-59e5-4614-965d-47a9bb4e3c09 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:13.898932 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a80985cf-59e5-4614-965d-47a9bb4e3c09 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:13.907717 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a80985cf-59e5-4614-965d-47a9bb4e3c09 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:13.908448 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a80985cf-59e5-4614-965d-47a9bb4e3c09 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:13.909402 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a80985cf-59e5-4614-965d-47a9bb4e3c09 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:13.909987 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a80985cf-59e5-4614-965d-47a9bb4e3c09 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:14.217220 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a80985cf-59e5-4614-965d-47a9bb4e3c09 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:14.228625 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:14.234248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a80985cf-59e5-4614-965d-47a9bb4e3c09 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:14.236626 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a80985cf-59e5-4614-965d-47a9bb4e3c09 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:14.238387 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a80985cf-59e5-4614-965d-47a9bb4e3c09 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1753 microversion: 2.20 time: 0.348836 Jun 16 14:59:14.239243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 278/555] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:13 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1753 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:14.291501 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f554a9f5-3ccf-4a66-b09e-94a84d93ac7f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:14.292783 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f554a9f5-3ccf-4a66-b09e-94a84d93ac7f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:14.302243 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f554a9f5-3ccf-4a66-b09e-94a84d93ac7f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:14.303333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f554a9f5-3ccf-4a66-b09e-94a84d93ac7f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:14.304760 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f554a9f5-3ccf-4a66-b09e-94a84d93ac7f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:14.306707 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f554a9f5-3ccf-4a66-b09e-94a84d93ac7f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:14.573594 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f554a9f5-3ccf-4a66-b09e-94a84d93ac7f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:14.581688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f554a9f5-3ccf-4a66-b09e-94a84d93ac7f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1370 microversion: 2.1 time: 0.300383 Jun 16 14:59:14.593967 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 278/556] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:14 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1370 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:14.752692 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-af89fbef-071c-4304-a422-f5e28ae88d89 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:14.753230 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-af89fbef-071c-4304-a422-f5e28ae88d89 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:14.766678 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-af89fbef-071c-4304-a422-f5e28ae88d89 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:14.767422 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-af89fbef-071c-4304-a422-f5e28ae88d89 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:14.768018 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-af89fbef-071c-4304-a422-f5e28ae88d89 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:14.768561 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-af89fbef-071c-4304-a422-f5e28ae88d89 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:15.030504 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-66948226-f242-49c1-ae70-70b52cd4b99a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:15.031209 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-66948226-f242-49c1-ae70-70b52cd4b99a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:15.034713 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-af89fbef-071c-4304-a422-f5e28ae88d89 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:15.042268 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-66948226-f242-49c1-ae70-70b52cd4b99a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:15.043011 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-66948226-f242-49c1-ae70-70b52cd4b99a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:15.043867 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-66948226-f242-49c1-ae70-70b52cd4b99a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:15.044362 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-66948226-f242-49c1-ae70-70b52cd4b99a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:15.046220 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-af89fbef-071c-4304-a422-f5e28ae88d89 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1319 microversion: 2.1 time: 0.297294 Jun 16 14:59:15.047129 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 279/557] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:14 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:15.258827 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7e031ed1-9fc7-469f-b8f5-d6db112becfb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:15.259126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7e031ed1-9fc7-469f-b8f5-d6db112becfb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:15.270607 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e031ed1-9fc7-469f-b8f5-d6db112becfb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:15.272506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e031ed1-9fc7-469f-b8f5-d6db112becfb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:15.275592 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e031ed1-9fc7-469f-b8f5-d6db112becfb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:15.276821 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e031ed1-9fc7-469f-b8f5-d6db112becfb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:15.343307 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-66948226-f242-49c1-ae70-70b52cd4b99a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:15.356297 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-66948226-f242-49c1-ae70-70b52cd4b99a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1594 microversion: 2.1 time: 0.332697 Jun 16 14:59:15.358538 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 279/558] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:15 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1594 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:15.468175 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-abeb64ea-c386-42bd-b061-a9a94e5b2c94 req-96ef253d-aa4b-4683-8961-d107eccb8c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14563c3c-bdd4-46f1-890f-bf0aa3045d69", "name": "network-vif-plugged", "status": "completed", "tag": "7423e547-f966-4e2a-8d0c-a9f36a726ddf"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:15.482711 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-abeb64ea-c386-42bd-b061-a9a94e5b2c94 req-96ef253d-aa4b-4683-8961-d107eccb8c22 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:15.483596 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-abeb64ea-c386-42bd-b061-a9a94e5b2c94 req-96ef253d-aa4b-4683-8961-d107eccb8c22 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:15.498249 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-abeb64ea-c386-42bd-b061-a9a94e5b2c94 req-96ef253d-aa4b-4683-8961-d107eccb8c22 service nova] Creating event network-vif-plugged:7423e547-f966-4e2a-8d0c-a9f36a726ddf for instance 14563c3c-bdd4-46f1-890f-bf0aa3045d69 on hv-cinder-83716 Jun 16 14:59:15.505313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-abeb64ea-c386-42bd-b061-a9a94e5b2c94 req-96ef253d-aa4b-4683-8961-d107eccb8c22 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044460 Jun 16 14:59:15.506801 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 280/559] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:59:15.614002 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-02010b53-ca8c-4b84-af27-0130076236f4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:15.616377 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-02010b53-ca8c-4b84-af27-0130076236f4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:15.644546 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7e031ed1-9fc7-469f-b8f5-d6db112becfb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:15.646383 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-02010b53-ca8c-4b84-af27-0130076236f4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:15.649698 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-02010b53-ca8c-4b84-af27-0130076236f4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:15.651098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-02010b53-ca8c-4b84-af27-0130076236f4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:15.652222 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-02010b53-ca8c-4b84-af27-0130076236f4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:15.712249 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7e031ed1-9fc7-469f-b8f5-d6db112becfb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:15.724615 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7e031ed1-9fc7-469f-b8f5-d6db112becfb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:15.731547 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7e031ed1-9fc7-469f-b8f5-d6db112becfb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1753 microversion: 2.20 time: 0.475800 Jun 16 14:59:15.738862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 280/560] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:15 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1753 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:59:16.024519 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-02010b53-ca8c-4b84-af27-0130076236f4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:16.040731 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-02010b53-ca8c-4b84-af27-0130076236f4 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1370 microversion: 2.1 time: 0.441241 Jun 16 14:59:16.051449 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 281/561] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:15 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1370 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:16.067610 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-0d375a02-0c32-4d72-a9cb-ae499598c984 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:16.068391 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-0d375a02-0c32-4d72-a9cb-ae499598c984 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:16.082583 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0d375a02-0c32-4d72-a9cb-ae499598c984 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:16.083579 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0d375a02-0c32-4d72-a9cb-ae499598c984 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:16.084854 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0d375a02-0c32-4d72-a9cb-ae499598c984 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:16.085627 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0d375a02-0c32-4d72-a9cb-ae499598c984 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:16.365832 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-0d375a02-0c32-4d72-a9cb-ae499598c984 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:16.374889 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-0d375a02-0c32-4d72-a9cb-ae499598c984 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1319 microversion: 2.1 time: 0.311460 Jun 16 14:59:16.389689 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 281/562] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:16 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:16.771087 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-969239ee-bb06-48f4-bf0d-b821023404c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:16.771824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-969239ee-bb06-48f4-bf0d-b821023404c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:16.787454 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-969239ee-bb06-48f4-bf0d-b821023404c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:16.788314 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-969239ee-bb06-48f4-bf0d-b821023404c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:16.789354 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-969239ee-bb06-48f4-bf0d-b821023404c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:16.792074 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-969239ee-bb06-48f4-bf0d-b821023404c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:17.073089 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4cc2246c-9d6d-4898-b104-10647af5b1b9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:17.073687 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4cc2246c-9d6d-4898-b104-10647af5b1b9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:17.077320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-969239ee-bb06-48f4-bf0d-b821023404c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:17.083587 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4cc2246c-9d6d-4898-b104-10647af5b1b9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:17.084147 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4cc2246c-9d6d-4898-b104-10647af5b1b9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:17.084993 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4cc2246c-9d6d-4898-b104-10647af5b1b9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:17.085892 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4cc2246c-9d6d-4898-b104-10647af5b1b9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:17.088871 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-969239ee-bb06-48f4-bf0d-b821023404c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:17.093818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-969239ee-bb06-48f4-bf0d-b821023404c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:17.097798 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-969239ee-bb06-48f4-bf0d-b821023404c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1753 microversion: 2.20 time: 0.332235 Jun 16 14:59:17.099268 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 282/563] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:16 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1753 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:17.290124 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4cc2246c-9d6d-4898-b104-10647af5b1b9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:17.305179 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4cc2246c-9d6d-4898-b104-10647af5b1b9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1565 microversion: 2.1 time: 0.238502 Jun 16 14:59:17.305944 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 282/564] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:17 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1565 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:17.333495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3a154538-3c86-4391-b926-e0e5e64728de tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:17.334257 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3a154538-3c86-4391-b926-e0e5e64728de tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:17.348690 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3a154538-3c86-4391-b926-e0e5e64728de tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:17.349146 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3a154538-3c86-4391-b926-e0e5e64728de tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:17.350220 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3a154538-3c86-4391-b926-e0e5e64728de tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:17.350830 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3a154538-3c86-4391-b926-e0e5e64728de tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:17.404774 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-65d7c4d2-0016-41a8-a1af-65f0839b8ed0 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:17.405570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-65d7c4d2-0016-41a8-a1af-65f0839b8ed0 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:17.412963 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-65d7c4d2-0016-41a8-a1af-65f0839b8ed0 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:17.413648 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-65d7c4d2-0016-41a8-a1af-65f0839b8ed0 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:17.414687 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-65d7c4d2-0016-41a8-a1af-65f0839b8ed0 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:17.415331 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-65d7c4d2-0016-41a8-a1af-65f0839b8ed0 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:17.467518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3a154538-3c86-4391-b926-e0e5e64728de tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143127 Jun 16 14:59:17.468338 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 283/565] 10.222.0.76 () {58 vars in 1274 bytes} [Thu Jun 16 14:59:17 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:59:18.094790 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-65d7c4d2-0016-41a8-a1af-65f0839b8ed0 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:18.104586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-65d7c4d2-0016-41a8-a1af-65f0839b8ed0 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1319 microversion: 2.1 time: 0.709577 Jun 16 14:59:18.105348 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 283/566] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:17 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1319 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:18.124186 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f9bfa92a-c4bc-4dc9-ad97-3472592e600c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:18.125405 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f9bfa92a-c4bc-4dc9-ad97-3472592e600c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:18.132825 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f9bfa92a-c4bc-4dc9-ad97-3472592e600c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:18.133606 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f9bfa92a-c4bc-4dc9-ad97-3472592e600c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:18.134623 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f9bfa92a-c4bc-4dc9-ad97-3472592e600c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:18.136058 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f9bfa92a-c4bc-4dc9-ad97-3472592e600c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:18.443484 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f9bfa92a-c4bc-4dc9-ad97-3472592e600c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:18.453016 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f9bfa92a-c4bc-4dc9-ad97-3472592e600c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:18.454663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f9bfa92a-c4bc-4dc9-ad97-3472592e600c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:18.455908 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f9bfa92a-c4bc-4dc9-ad97-3472592e600c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.340611 Jun 16 14:59:18.456472 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 284/567] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:18 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:19.067669 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-d4ee46b1-8327-48a1-89c7-522a4033f717 req-d92096f4-05f5-4376-ad0d-24a554623c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "120f403f-a9e1-4359-9e3b-6d3a98a5c7af", "tag": "b069c8fa-e747-4081-a398-e94c5755297b"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:19.083338 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-d4ee46b1-8327-48a1-89c7-522a4033f717 req-d92096f4-05f5-4376-ad0d-24a554623c84 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:19.084149 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-d4ee46b1-8327-48a1-89c7-522a4033f717 req-d92096f4-05f5-4376-ad0d-24a554623c84 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:19.136852 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-160bf4bc-b8b1-41c5-8440-2864d237000c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:19.140072 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-160bf4bc-b8b1-41c5-8440-2864d237000c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:19.143158 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-d4ee46b1-8327-48a1-89c7-522a4033f717 req-d92096f4-05f5-4376-ad0d-24a554623c84 service nova] Creating event network-changed:b069c8fa-e747-4081-a398-e94c5755297b for instance 120f403f-a9e1-4359-9e3b-6d3a98a5c7af on hv-cinder-83716 Jun 16 14:59:19.167786 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-d4ee46b1-8327-48a1-89c7-522a4033f717 req-d92096f4-05f5-4376-ad0d-24a554623c84 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100642 Jun 16 14:59:19.170548 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 284/568] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:59:19.175522 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-160bf4bc-b8b1-41c5-8440-2864d237000c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:19.176426 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-160bf4bc-b8b1-41c5-8440-2864d237000c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:19.177796 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-160bf4bc-b8b1-41c5-8440-2864d237000c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:19.178701 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-160bf4bc-b8b1-41c5-8440-2864d237000c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:19.490800 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-daaf05d1-fd80-408e-9771-8c975f6a92cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:19.491635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-daaf05d1-fd80-408e-9771-8c975f6a92cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:19.510299 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-daaf05d1-fd80-408e-9771-8c975f6a92cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:19.512953 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-daaf05d1-fd80-408e-9771-8c975f6a92cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:19.513826 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-daaf05d1-fd80-408e-9771-8c975f6a92cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:19.514268 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-daaf05d1-fd80-408e-9771-8c975f6a92cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:20.025211 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-160bf4bc-b8b1-41c5-8440-2864d237000c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:20.045722 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-160bf4bc-b8b1-41c5-8440-2864d237000c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1507 microversion: 2.1 time: 0.926237 Jun 16 14:59:20.051022 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 285/569] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:19 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1507 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:20.068257 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5ac1cd39-c770-43e6-8c64-97b3ba855dfe tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11efa797-2982-4896-831c-1e9b0c1cdd19", "device": "/dev/sdb"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:20.070191 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5ac1cd39-c770-43e6-8c64-97b3ba855dfe tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:20.090914 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5ac1cd39-c770-43e6-8c64-97b3ba855dfe tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:20.092478 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5ac1cd39-c770-43e6-8c64-97b3ba855dfe tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:20.093602 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5ac1cd39-c770-43e6-8c64-97b3ba855dfe tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:20.094222 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5ac1cd39-c770-43e6-8c64-97b3ba855dfe tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:20.283730 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-daaf05d1-fd80-408e-9771-8c975f6a92cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:20.306210 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-daaf05d1-fd80-408e-9771-8c975f6a92cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:20.315221 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-daaf05d1-fd80-408e-9771-8c975f6a92cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:20.316544 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-daaf05d1-fd80-408e-9771-8c975f6a92cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.834950 Jun 16 14:59:20.317286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 285/570] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:19 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:20.334164 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-f026f4de-5bcb-4c6d-84e8-0d0bf47d96b0 req-b037645e-64fa-4450-b7c2-41b3abcc9021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b469ddcc-e9b1-4c39-9c75-3b98f6f624c3", "tag": "4ac5eb81-f7f2-453f-a4f4-fba5e3e3d8d9"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:20.358523 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-f026f4de-5bcb-4c6d-84e8-0d0bf47d96b0 req-b037645e-64fa-4450-b7c2-41b3abcc9021 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:20.359285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-f026f4de-5bcb-4c6d-84e8-0d0bf47d96b0 req-b037645e-64fa-4450-b7c2-41b3abcc9021 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:20.421877 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-f026f4de-5bcb-4c6d-84e8-0d0bf47d96b0 req-b037645e-64fa-4450-b7c2-41b3abcc9021 service nova] Creating event network-changed:4ac5eb81-f7f2-453f-a4f4-fba5e3e3d8d9 for instance b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 on hv-cinder-83716 Jun 16 14:59:20.434473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-f026f4de-5bcb-4c6d-84e8-0d0bf47d96b0 req-b037645e-64fa-4450-b7c2-41b3abcc9021 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104254 Jun 16 14:59:20.435122 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 286/571] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:59:20.572050 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5ac1cd39-c770-43e6-8c64-97b3ba855dfe tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "POST /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.508804 Jun 16 14:59:20.572669 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 286/572] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Jun 16 14:59:20 2022] POST /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69/os-volume_attachments => generated 194 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:59:21.011043 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-5cb1a902-444f-40b1-a339-0561ce1b2cf0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:21.013156 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-5cb1a902-444f-40b1-a339-0561ce1b2cf0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:21.034240 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5cb1a902-444f-40b1-a339-0561ce1b2cf0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:21.035759 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5cb1a902-444f-40b1-a339-0561ce1b2cf0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:21.039110 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5cb1a902-444f-40b1-a339-0561ce1b2cf0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:21.039889 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5cb1a902-444f-40b1-a339-0561ce1b2cf0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:21.098945 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-5cb1a902-444f-40b1-a339-0561ce1b2cf0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8/ips" status: 200 len: 149 microversion: 2.1 time: 0.095345 Jun 16 14:59:21.100298 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 287/573] 10.222.0.76 () {58 vars in 1247 bytes} [Thu Jun 16 14:59:20 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8/ips => generated 149 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:59:21.127206 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2d46d038-b640-428e-8c84-4ea9ca7bb36c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17712aaf-f87a-4a4c-ae2c-ca14dfebbc25"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:21.142916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2d46d038-b640-428e-8c84-4ea9ca7bb36c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:21.189938 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2d46d038-b640-428e-8c84-4ea9ca7bb36c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:21.190406 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2d46d038-b640-428e-8c84-4ea9ca7bb36c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:21.191197 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2d46d038-b640-428e-8c84-4ea9ca7bb36c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:21.192117 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2d46d038-b640-428e-8c84-4ea9ca7bb36c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:21.316323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-2d46d038-b640-428e-8c84-4ea9ca7bb36c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] HTTP exception thrown: Invalid volume: volume 17712aaf-f87a-4a4c-ae2c-ca14dfebbc25 is already attached to instances: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2d46d038-b640-428e-8c84-4ea9ca7bb36c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Request method failure captured: Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: POST /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8/os-volume_attachments HTTP/1.1 Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 74 Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0RvgNnHERAvlrn1WvFUUcvodkCzzgEgc9uA3Ra8J3x-gaqNyXJgZlXW9Fu3DW2tOgMnX7C8vwaaaUd2R9Mf98qk7wOTE2lojDUYY_ofhKl3QsPjUp0j-B30CwpTfHwGiZa1GU9kj2dLQMYLnA0B8U66Nc60nNiPBn1l71iNpcPmPQ4 Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 14:59:21.318094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 14:59:21.319437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_60ade68614ac4730a35c9958123d06e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:59:21.319437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 14:59:21.319437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 14:59:21.319437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 14:59:21.319437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 14:59:21.319437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 14:59:21.319437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 14:59:21.319437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 87a6ec62b5414930bf36f69f072d7df6 Jun 16 14:59:21.319437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 14:59:21.319437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Jun 16 14:59:21.319437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {"volumeAttachment": {"volumeId": "17712aaf-f87a-4a4c-ae2c-ca14dfebbc25"}} Jun 16 14:59:21.319437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Invalid volume: volume 17712aaf-f87a-4a4c-ae2c-ca14dfebbc25 is already attached to instances: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'server_id': '36bbbe9f-1cae-453f-9d25-38654f3e30a8', 'body': {'volumeAttachment': {'volumeId': '17712aaf-f87a-4a4c-ae2c-ca14dfebbc25'}}} Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 17712aaf-f87a-4a4c-ae2c-ca14dfebbc25 is already attached to instances: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:59:21.320251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 17712aaf-f87a-4a4c-ae2c-ca14dfebbc25 is already attached to instances: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:21.321415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:59:21.326646 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:59:21.326646 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:59:21.326646 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:59:21.326646 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 17712aaf-f87a-4a4c-ae2c-ca14dfebbc25 is already attached to instances: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 Jun 16 14:59:21.326646 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 14:59:21.326646 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2d46d038-b640-428e-8c84-4ea9ca7bb36c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Returning 400 to user: Invalid volume: volume 17712aaf-f87a-4a4c-ae2c-ca14dfebbc25 is already attached to instances: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:59:21.326646 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2d46d038-b640-428e-8c84-4ea9ca7bb36c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "POST /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.209839 Jun 16 14:59:21.326646 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 287/574] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Jun 16 14:59:21 2022] POST /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8/os-volume_attachments => generated 174 bytes in 216 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 14:59:21.330841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-988bf673-f0b8-493a-abad-77ea48440aba tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:21.331506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-988bf673-f0b8-493a-abad-77ea48440aba tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:21.336764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5bdaf452-9efe-4874-ba60-e4c4a67b63b0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:21.337301 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5bdaf452-9efe-4874-ba60-e4c4a67b63b0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:21.347509 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-988bf673-f0b8-493a-abad-77ea48440aba tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:21.358738 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5bdaf452-9efe-4874-ba60-e4c4a67b63b0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:21.359051 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-988bf673-f0b8-493a-abad-77ea48440aba tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:21.359987 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5bdaf452-9efe-4874-ba60-e4c4a67b63b0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:21.360576 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-988bf673-f0b8-493a-abad-77ea48440aba tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:21.361331 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5bdaf452-9efe-4874-ba60-e4c4a67b63b0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:21.361452 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-988bf673-f0b8-493a-abad-77ea48440aba tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:21.362253 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5bdaf452-9efe-4874-ba60-e4c4a67b63b0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:21.425147 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-988bf673-f0b8-493a-abad-77ea48440aba tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Going to try to terminate instance {{(pid=117443) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:59:21.623353 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-988bf673-f0b8-493a-abad-77ea48440aba tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "DELETE /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 204 len: 0 microversion: 2.1 time: 0.297719 Jun 16 14:59:21.625056 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 288/575] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 14:59:21 2022] DELETE /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:59:21.641735 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-097231b8-19a5-4f88-8198-e3b65c03b02d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:21.644481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-097231b8-19a5-4f88-8198-e3b65c03b02d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:21.680911 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-097231b8-19a5-4f88-8198-e3b65c03b02d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:21.682027 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-097231b8-19a5-4f88-8198-e3b65c03b02d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:21.685873 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-097231b8-19a5-4f88-8198-e3b65c03b02d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:21.687090 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-097231b8-19a5-4f88-8198-e3b65c03b02d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:21.956479 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-097231b8-19a5-4f88-8198-e3b65c03b02d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:21.982887 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-097231b8-19a5-4f88-8198-e3b65c03b02d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1681 microversion: 2.1 time: 0.343230 Jun 16 14:59:21.983366 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5bdaf452-9efe-4874-ba60-e4c4a67b63b0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:21.987433 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 289/576] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:21 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1681 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:22.014411 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5bdaf452-9efe-4874-ba60-e4c4a67b63b0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:22.021071 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5bdaf452-9efe-4874-ba60-e4c4a67b63b0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:22.023201 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5bdaf452-9efe-4874-ba60-e4c4a67b63b0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.691473 Jun 16 14:59:22.024492 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 288/577] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:21 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:23.005255 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-79d65db9-3c86-42a7-a132-4b0fe9ac2391 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:23.006565 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-79d65db9-3c86-42a7-a132-4b0fe9ac2391 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:23.035291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-79d65db9-3c86-42a7-a132-4b0fe9ac2391 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:23.045295 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-832acf96-0907-42c0-9301-a7f81dff26f1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:23.045968 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-832acf96-0907-42c0-9301-a7f81dff26f1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:23.054475 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-79d65db9-3c86-42a7-a132-4b0fe9ac2391 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:23.058411 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-79d65db9-3c86-42a7-a132-4b0fe9ac2391 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:23.060415 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-79d65db9-3c86-42a7-a132-4b0fe9ac2391 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:23.071442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-832acf96-0907-42c0-9301-a7f81dff26f1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:23.073371 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-832acf96-0907-42c0-9301-a7f81dff26f1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:23.078917 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-832acf96-0907-42c0-9301-a7f81dff26f1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:23.080195 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-832acf96-0907-42c0-9301-a7f81dff26f1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:23.759754 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-79d65db9-3c86-42a7-a132-4b0fe9ac2391 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:23.769355 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-79d65db9-3c86-42a7-a132-4b0fe9ac2391 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1681 microversion: 2.1 time: 0.768428 Jun 16 14:59:23.780037 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 290/578] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:22 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1681 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:23.886341 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-11bd7bc3-8ec1-4391-9f6e-9d419f4c6ffa tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-749114091"}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:23.887259 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-11bd7bc3-8ec1-4391-9f6e-9d419f4c6ffa tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:23.908759 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-11bd7bc3-8ec1-4391-9f6e-9d419f4c6ffa tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:23.909493 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-11bd7bc3-8ec1-4391-9f6e-9d419f4c6ffa tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:23.911389 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-11bd7bc3-8ec1-4391-9f6e-9d419f4c6ffa tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:23.912164 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-11bd7bc3-8ec1-4391-9f6e-9d419f4c6ffa tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:24.120739 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-832acf96-0907-42c0-9301-a7f81dff26f1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:24.167251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-832acf96-0907-42c0-9301-a7f81dff26f1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:24.176137 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-832acf96-0907-42c0-9301-a7f81dff26f1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:24.178415 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-832acf96-0907-42c0-9301-a7f81dff26f1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 1.138860 Jun 16 14:59:24.179721 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 289/579] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:23 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:24.518271 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.network.security_group_api [None req-11bd7bc3-8ec1-4391-9f6e-9d419f4c6ffa tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Adding security group fdb2c090-e84b-4a86-828e-7fd1f9091c31 to port b069c8fa-e747-4081-a398-e94c5755297b Jun 16 14:59:24.795601 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-284d6cbc-e3ef-4b44-8d77-e9765bb4a748 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:24.797952 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-284d6cbc-e3ef-4b44-8d77-e9765bb4a748 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:24.843171 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-284d6cbc-e3ef-4b44-8d77-e9765bb4a748 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:24.845385 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-284d6cbc-e3ef-4b44-8d77-e9765bb4a748 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:24.848464 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-284d6cbc-e3ef-4b44-8d77-e9765bb4a748 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:24.849810 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-284d6cbc-e3ef-4b44-8d77-e9765bb4a748 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:25.674709 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-284d6cbc-e3ef-4b44-8d77-e9765bb4a748 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:25.703786 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-284d6cbc-e3ef-4b44-8d77-e9765bb4a748 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1681 microversion: 2.1 time: 0.918267 Jun 16 14:59:25.717038 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 290/580] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:24 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1681 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:25.724206 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-42362c78-0f24-4924-a176-44e6ab7b54be tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:25.726943 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-42362c78-0f24-4924-a176-44e6ab7b54be tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:25.752053 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-42362c78-0f24-4924-a176-44e6ab7b54be tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:25.760187 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-42362c78-0f24-4924-a176-44e6ab7b54be tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:25.762704 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-42362c78-0f24-4924-a176-44e6ab7b54be tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:25.766115 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-42362c78-0f24-4924-a176-44e6ab7b54be tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:26.391330 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-42362c78-0f24-4924-a176-44e6ab7b54be tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:26.406796 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-42362c78-0f24-4924-a176-44e6ab7b54be tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:26.413022 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-42362c78-0f24-4924-a176-44e6ab7b54be tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:26.416205 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-42362c78-0f24-4924-a176-44e6ab7b54be tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.696002 Jun 16 14:59:26.418264 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 291/581] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:25 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:26.723573 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-6878dce4-5d8f-466e-b1c7-1031fcbbd2e5 req-0430ac40-3ce5-4a85-98ba-4a47f7a611e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36bbbe9f-1cae-453f-9d25-38654f3e30a8", "name": "network-vif-deleted", "tag": "b960162a-2e73-4c2d-9e31-9b643f7e6471"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:26.753134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-6878dce4-5d8f-466e-b1c7-1031fcbbd2e5 req-0430ac40-3ce5-4a85-98ba-4a47f7a611e6 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:26.755378 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-6878dce4-5d8f-466e-b1c7-1031fcbbd2e5 req-0430ac40-3ce5-4a85-98ba-4a47f7a611e6 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:26.776531 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-6878dce4-5d8f-466e-b1c7-1031fcbbd2e5 req-0430ac40-3ce5-4a85-98ba-4a47f7a611e6 service nova] Creating event network-vif-deleted:b960162a-2e73-4c2d-9e31-9b643f7e6471 for instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 on hv-cinder-83716 Jun 16 14:59:26.786612 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-6878dce4-5d8f-466e-b1c7-1031fcbbd2e5 req-0430ac40-3ce5-4a85-98ba-4a47f7a611e6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089432 Jun 16 14:59:26.789567 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 292/582] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:59:26.799587 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-75e92475-2615-4f95-b19f-d8e53019f534 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:26.803054 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-75e92475-2615-4f95-b19f-d8e53019f534 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:26.820924 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75e92475-2615-4f95-b19f-d8e53019f534 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:26.821968 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75e92475-2615-4f95-b19f-d8e53019f534 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:26.823737 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75e92475-2615-4f95-b19f-d8e53019f534 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:26.824723 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75e92475-2615-4f95-b19f-d8e53019f534 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:26.830918 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:26.843784 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-11bd7bc3-8ec1-4391-9f6e-9d419f4c6ffa tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "POST /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/action" status: 202 len: 0 microversion: 2.1 time: 2.962336 Jun 16 14:59:26.847409 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 291/583] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Jun 16 14:59:23 2022] POST /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/action => generated 0 bytes in 2964 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 14:59:26.852565 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e8709870-9d65-46fd-bed3-2300bd68a163 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:26.853185 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e8709870-9d65-46fd-bed3-2300bd68a163 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:26.863368 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e8709870-9d65-46fd-bed3-2300bd68a163 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:26.863927 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e8709870-9d65-46fd-bed3-2300bd68a163 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:26.864726 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e8709870-9d65-46fd-bed3-2300bd68a163 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:26.865160 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e8709870-9d65-46fd-bed3-2300bd68a163 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:26.970106 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-75e92475-2615-4f95-b19f-d8e53019f534 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:26.986244 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-75e92475-2615-4f95-b19f-d8e53019f534 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1614 microversion: 2.1 time: 0.195140 Jun 16 14:59:26.994707 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 293/584] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:26 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1614 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:27.018901 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-b5a81bf3-5acc-493e-85a4-e225fa857f88 req-98914cf1-2dfe-48e8-abff-332585e27d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "120f403f-a9e1-4359-9e3b-6d3a98a5c7af", "tag": "b069c8fa-e747-4081-a398-e94c5755297b"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:27.041886 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-b5a81bf3-5acc-493e-85a4-e225fa857f88 req-98914cf1-2dfe-48e8-abff-332585e27d7a service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:27.043236 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-b5a81bf3-5acc-493e-85a4-e225fa857f88 req-98914cf1-2dfe-48e8-abff-332585e27d7a service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:27.069142 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-b5a81bf3-5acc-493e-85a4-e225fa857f88 req-98914cf1-2dfe-48e8-abff-332585e27d7a service nova] Creating event network-changed:b069c8fa-e747-4081-a398-e94c5755297b for instance 120f403f-a9e1-4359-9e3b-6d3a98a5c7af on hv-cinder-83716 Jun 16 14:59:27.075474 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-b5a81bf3-5acc-493e-85a4-e225fa857f88 req-98914cf1-2dfe-48e8-abff-332585e27d7a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078663 Jun 16 14:59:27.077149 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 294/585] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 14:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:59:27.229016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e8709870-9d65-46fd-bed3-2300bd68a163 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:27.269880 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e8709870-9d65-46fd-bed3-2300bd68a163 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1758 microversion: 2.1 time: 0.419267 Jun 16 14:59:27.275182 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 292/586] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:26 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1758 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:27.439599 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8c8493de-5599-47d7-bfed-f442b567465a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:27.440363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8c8493de-5599-47d7-bfed-f442b567465a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:27.457810 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8c8493de-5599-47d7-bfed-f442b567465a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:27.458269 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8c8493de-5599-47d7-bfed-f442b567465a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:27.459160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8c8493de-5599-47d7-bfed-f442b567465a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:27.465597 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8c8493de-5599-47d7-bfed-f442b567465a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:28.023735 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-187e3cdb-fc4b-41ef-8949-2bceef5a109f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:28.037843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-187e3cdb-fc4b-41ef-8949-2bceef5a109f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:28.064585 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-187e3cdb-fc4b-41ef-8949-2bceef5a109f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:28.068589 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-187e3cdb-fc4b-41ef-8949-2bceef5a109f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:28.069743 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-187e3cdb-fc4b-41ef-8949-2bceef5a109f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:28.070419 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-187e3cdb-fc4b-41ef-8949-2bceef5a109f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:28.144084 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8c8493de-5599-47d7-bfed-f442b567465a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:28.154000 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8c8493de-5599-47d7-bfed-f442b567465a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:28.162347 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8c8493de-5599-47d7-bfed-f442b567465a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:28.166303 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8c8493de-5599-47d7-bfed-f442b567465a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.733712 Jun 16 14:59:28.167976 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 295/587] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:27 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:28.198862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-187e3cdb-fc4b-41ef-8949-2bceef5a109f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:28.210467 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-187e3cdb-fc4b-41ef-8949-2bceef5a109f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1327 microversion: 2.1 time: 0.199804 Jun 16 14:59:28.213121 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 293/588] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:28 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1327 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:29.194274 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3454c036-731b-4dd5-99d4-b15d9ab405e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:29.200468 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3454c036-731b-4dd5-99d4-b15d9ab405e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:29.221603 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:29.244826 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7be41040-f2ad-407e-8d86-d91e414cbe6f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:29.261459 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7be41040-f2ad-407e-8d86-d91e414cbe6f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:29.266668 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3454c036-731b-4dd5-99d4-b15d9ab405e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:29.268240 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3454c036-731b-4dd5-99d4-b15d9ab405e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:29.269090 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3454c036-731b-4dd5-99d4-b15d9ab405e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:29.269545 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3454c036-731b-4dd5-99d4-b15d9ab405e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:29.283312 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:29.312180 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7be41040-f2ad-407e-8d86-d91e414cbe6f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:29.313046 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7be41040-f2ad-407e-8d86-d91e414cbe6f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:29.313962 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7be41040-f2ad-407e-8d86-d91e414cbe6f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:29.314761 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7be41040-f2ad-407e-8d86-d91e414cbe6f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:29.718598 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7be41040-f2ad-407e-8d86-d91e414cbe6f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:29.734959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7be41040-f2ad-407e-8d86-d91e414cbe6f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1327 microversion: 2.1 time: 0.505202 Jun 16 14:59:29.736299 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 294/589] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:29 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1327 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:29.884918 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3454c036-731b-4dd5-99d4-b15d9ab405e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:29.914637 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3454c036-731b-4dd5-99d4-b15d9ab405e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:29.917596 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3454c036-731b-4dd5-99d4-b15d9ab405e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:29.922219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3454c036-731b-4dd5-99d4-b15d9ab405e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.736761 Jun 16 14:59:29.923640 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 296/590] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:29 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:30.421844 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-94ca469f-780a-4bb5-a691-cd043cfbe33d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Action: 'create', calling method: .version_select at 0x7f33e131d280>, body: {"keypair": {"name": "tempest-TestShelveInstance-293733398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjpDP/sQ0l1sIyBFHiymGKNe4BsNZWjbVVbNah21YP0teFNxJ+pI/uVOZ0ix7XUqlToYDeZMbUO8UVN0Qs74ikqB/MjIY4c16cMXw7OQy3ICex4GhEYWHSiolQrZuzY3Q=="}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:30.437817 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-94ca469f-780a-4bb5-a691-cd043cfbe33d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Getting quotas for project 646f903869dd413b839067743f25278c. Resources: {'key_pairs'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:59:30.442535 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-94ca469f-780a-4bb5-a691-cd043cfbe33d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Getting quotas for user 9f943a0852a74679b940f20a87f15d71 and project 646f903869dd413b839067743f25278c. Resources: {'key_pairs'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:59:30.470095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-94ca469f-780a-4bb5-a691-cd043cfbe33d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.285971 Jun 16 14:59:30.471508 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 295/591] 10.222.0.76 () {60 vars in 1158 bytes} [Thu Jun 16 14:59:30 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:59:30.754517 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6da78e86-ba77-4ccc-8973-f0348f3e62f9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:30.755174 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6da78e86-ba77-4ccc-8973-f0348f3e62f9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:30.765000 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6da78e86-ba77-4ccc-8973-f0348f3e62f9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:30.765766 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6da78e86-ba77-4ccc-8973-f0348f3e62f9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:30.767694 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6da78e86-ba77-4ccc-8973-f0348f3e62f9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:30.768845 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6da78e86-ba77-4ccc-8973-f0348f3e62f9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:30.864347 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6da78e86-ba77-4ccc-8973-f0348f3e62f9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:30.876072 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6da78e86-ba77-4ccc-8973-f0348f3e62f9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1327 microversion: 2.1 time: 0.125886 Jun 16 14:59:30.877332 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 297/592] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:30 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1327 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:30.943592 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-93562663-2b72-4efe-bca5-f8daea6292c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:30.944379 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-93562663-2b72-4efe-bca5-f8daea6292c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:30.951334 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-93562663-2b72-4efe-bca5-f8daea6292c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:30.952212 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-93562663-2b72-4efe-bca5-f8daea6292c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:30.953029 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-93562663-2b72-4efe-bca5-f8daea6292c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:30.953509 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-93562663-2b72-4efe-bca5-f8daea6292c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:31.175059 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-93562663-2b72-4efe-bca5-f8daea6292c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:31.179024 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:31.186214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-93562663-2b72-4efe-bca5-f8daea6292c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:31.189354 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-93562663-2b72-4efe-bca5-f8daea6292c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:31.195140 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-93562663-2b72-4efe-bca5-f8daea6292c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.253899 Jun 16 14:59:31.200795 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 296/593] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:30 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:31.902137 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-434be88d-672d-4d24-ae07-81062cbf544f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:31.902987 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-434be88d-672d-4d24-ae07-81062cbf544f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:31.913727 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-434be88d-672d-4d24-ae07-81062cbf544f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:31.916810 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-434be88d-672d-4d24-ae07-81062cbf544f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:31.917938 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-434be88d-672d-4d24-ae07-81062cbf544f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:31.918596 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-434be88d-672d-4d24-ae07-81062cbf544f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:32.034686 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-434be88d-672d-4d24-ae07-81062cbf544f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:32.046751 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-434be88d-672d-4d24-ae07-81062cbf544f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1327 microversion: 2.1 time: 0.148376 Jun 16 14:59:32.047350 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 298/594] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:31 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1327 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:32.221093 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f7c5d06a-e8c4-4ac1-9f87-d8c75087051d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:32.221739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f7c5d06a-e8c4-4ac1-9f87-d8c75087051d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:32.229449 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f7c5d06a-e8c4-4ac1-9f87-d8c75087051d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:32.230189 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f7c5d06a-e8c4-4ac1-9f87-d8c75087051d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:32.230999 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f7c5d06a-e8c4-4ac1-9f87-d8c75087051d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:32.231706 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f7c5d06a-e8c4-4ac1-9f87-d8c75087051d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:32.401632 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f7c5d06a-e8c4-4ac1-9f87-d8c75087051d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:32.412218 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f7c5d06a-e8c4-4ac1-9f87-d8c75087051d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:32.413905 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f7c5d06a-e8c4-4ac1-9f87-d8c75087051d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:32.415107 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f7c5d06a-e8c4-4ac1-9f87-d8c75087051d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.197904 Jun 16 14:59:32.416424 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 297/595] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:32 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:33.072077 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-721bedda-4396-494f-b2d2-545742cc4493 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:33.073362 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-721bedda-4396-494f-b2d2-545742cc4493 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:33.081444 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-721bedda-4396-494f-b2d2-545742cc4493 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:33.081678 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-721bedda-4396-494f-b2d2-545742cc4493 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:33.082756 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-721bedda-4396-494f-b2d2-545742cc4493 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:33.083548 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-721bedda-4396-494f-b2d2-545742cc4493 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:33.227092 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-721bedda-4396-494f-b2d2-545742cc4493 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:33.236016 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-721bedda-4396-494f-b2d2-545742cc4493 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1327 microversion: 2.1 time: 0.167968 Jun 16 14:59:33.236700 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 299/596] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:33 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1327 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:33.436374 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-62c3108f-d2b4-4bb5-89bd-5126d23a588d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:33.437666 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-62c3108f-d2b4-4bb5-89bd-5126d23a588d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:33.444543 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-62c3108f-d2b4-4bb5-89bd-5126d23a588d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:33.445346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-62c3108f-d2b4-4bb5-89bd-5126d23a588d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:33.446344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-62c3108f-d2b4-4bb5-89bd-5126d23a588d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:33.447003 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-62c3108f-d2b4-4bb5-89bd-5126d23a588d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:33.655123 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-62c3108f-d2b4-4bb5-89bd-5126d23a588d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:33.665658 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-62c3108f-d2b4-4bb5-89bd-5126d23a588d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:33.667289 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-62c3108f-d2b4-4bb5-89bd-5126d23a588d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:33.668550 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-62c3108f-d2b4-4bb5-89bd-5126d23a588d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.236958 Jun 16 14:59:33.669691 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 298/597] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:33 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:34.254669 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2e40f9cc-da64-45e9-a075-52ba860609a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:34.255398 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2e40f9cc-da64-45e9-a075-52ba860609a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:34.263599 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2e40f9cc-da64-45e9-a075-52ba860609a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:34.265496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2e40f9cc-da64-45e9-a075-52ba860609a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:34.265836 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2e40f9cc-da64-45e9-a075-52ba860609a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:34.266563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2e40f9cc-da64-45e9-a075-52ba860609a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:34.360343 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2e40f9cc-da64-45e9-a075-52ba860609a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:34.370001 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2e40f9cc-da64-45e9-a075-52ba860609a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1327 microversion: 2.1 time: 0.119414 Jun 16 14:59:34.376411 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 300/598] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:34 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:34.689169 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7c8db84c-71f8-4399-9735-6e9664534ac6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:34.691076 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7c8db84c-71f8-4399-9735-6e9664534ac6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:34.697739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7c8db84c-71f8-4399-9735-6e9664534ac6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:34.698179 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7c8db84c-71f8-4399-9735-6e9664534ac6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:34.698946 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7c8db84c-71f8-4399-9735-6e9664534ac6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:34.699380 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7c8db84c-71f8-4399-9735-6e9664534ac6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:34.860105 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7c8db84c-71f8-4399-9735-6e9664534ac6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:34.869392 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7c8db84c-71f8-4399-9735-6e9664534ac6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:34.870951 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7c8db84c-71f8-4399-9735-6e9664534ac6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:34.872277 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7c8db84c-71f8-4399-9735-6e9664534ac6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.187650 Jun 16 14:59:34.872804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 299/599] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:34 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:35.387529 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-60e5ac65-0a28-41db-a940-086a4037d2df tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:35.388827 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-60e5ac65-0a28-41db-a940-086a4037d2df tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:35.398047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-60e5ac65-0a28-41db-a940-086a4037d2df tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:35.398521 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-60e5ac65-0a28-41db-a940-086a4037d2df tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:35.399814 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-60e5ac65-0a28-41db-a940-086a4037d2df tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:35.400283 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-60e5ac65-0a28-41db-a940-086a4037d2df tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:35.490041 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-60e5ac65-0a28-41db-a940-086a4037d2df tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:35.501392 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-60e5ac65-0a28-41db-a940-086a4037d2df tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1327 microversion: 2.1 time: 0.117404 Jun 16 14:59:35.507984 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 301/600] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:35 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1327 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:35.892859 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3d678f29-6c5c-42c2-beea-f8f888874dcc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:35.893451 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-3d678f29-6c5c-42c2-beea-f8f888874dcc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:35.899556 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3d678f29-6c5c-42c2-beea-f8f888874dcc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:35.900026 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3d678f29-6c5c-42c2-beea-f8f888874dcc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:35.900793 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3d678f29-6c5c-42c2-beea-f8f888874dcc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:35.901214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3d678f29-6c5c-42c2-beea-f8f888874dcc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:36.069035 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3d678f29-6c5c-42c2-beea-f8f888874dcc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:36.078346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3d678f29-6c5c-42c2-beea-f8f888874dcc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:36.079756 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3d678f29-6c5c-42c2-beea-f8f888874dcc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:36.081205 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3d678f29-6c5c-42c2-beea-f8f888874dcc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.192358 Jun 16 14:59:36.081972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 300/601] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:35 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:36.521879 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-56fad504-72dd-458c-bc17-8ce8999d6062 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:36.522471 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-56fad504-72dd-458c-bc17-8ce8999d6062 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:36.529703 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-56fad504-72dd-458c-bc17-8ce8999d6062 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:36.530148 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-56fad504-72dd-458c-bc17-8ce8999d6062 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:36.530928 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-56fad504-72dd-458c-bc17-8ce8999d6062 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:36.531421 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-56fad504-72dd-458c-bc17-8ce8999d6062 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:36.595983 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-56fad504-72dd-458c-bc17-8ce8999d6062 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:36.603618 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-56fad504-72dd-458c-bc17-8ce8999d6062 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1327 microversion: 2.1 time: 0.085603 Jun 16 14:59:36.604250 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 302/602] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:36 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1327 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:37.101037 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-35b4a91b-81ff-4e7c-8d52-60567bfce483 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:37.101597 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-35b4a91b-81ff-4e7c-8d52-60567bfce483 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:37.109278 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-35b4a91b-81ff-4e7c-8d52-60567bfce483 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:37.109919 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-35b4a91b-81ff-4e7c-8d52-60567bfce483 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:37.110769 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-35b4a91b-81ff-4e7c-8d52-60567bfce483 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:37.111202 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-35b4a91b-81ff-4e7c-8d52-60567bfce483 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:37.253118 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-35b4a91b-81ff-4e7c-8d52-60567bfce483 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:37.263059 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-35b4a91b-81ff-4e7c-8d52-60567bfce483 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:37.264610 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-35b4a91b-81ff-4e7c-8d52-60567bfce483 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:37.265771 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-35b4a91b-81ff-4e7c-8d52-60567bfce483 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.168904 Jun 16 14:59:37.266327 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 301/603] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:37 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:37.621474 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c2572eaf-1fbc-43b9-812b-4ae933048382 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:37.622071 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c2572eaf-1fbc-43b9-812b-4ae933048382 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:37.628823 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c2572eaf-1fbc-43b9-812b-4ae933048382 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:37.629274 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c2572eaf-1fbc-43b9-812b-4ae933048382 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:37.630038 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c2572eaf-1fbc-43b9-812b-4ae933048382 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:37.630593 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c2572eaf-1fbc-43b9-812b-4ae933048382 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:37.705643 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c2572eaf-1fbc-43b9-812b-4ae933048382 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:37.713375 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c2572eaf-1fbc-43b9-812b-4ae933048382 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1327 microversion: 2.1 time: 0.095901 Jun 16 14:59:37.713944 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 303/604] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:37 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:38.285624 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-dcc6f9f7-a30f-446a-9239-f748009e593b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:38.286377 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-dcc6f9f7-a30f-446a-9239-f748009e593b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:38.293836 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dcc6f9f7-a30f-446a-9239-f748009e593b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:38.294342 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dcc6f9f7-a30f-446a-9239-f748009e593b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:38.295381 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dcc6f9f7-a30f-446a-9239-f748009e593b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:38.295580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dcc6f9f7-a30f-446a-9239-f748009e593b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:38.457500 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-dcc6f9f7-a30f-446a-9239-f748009e593b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:38.470692 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-dcc6f9f7-a30f-446a-9239-f748009e593b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:38.472236 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-dcc6f9f7-a30f-446a-9239-f748009e593b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:38.473658 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-dcc6f9f7-a30f-446a-9239-f748009e593b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.192923 Jun 16 14:59:38.474800 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 302/605] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:38 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:38.735869 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6f1c296c-4975-4cff-b1dd-4d707638966e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:38.736482 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6f1c296c-4975-4cff-b1dd-4d707638966e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:38.743571 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6f1c296c-4975-4cff-b1dd-4d707638966e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:38.744062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6f1c296c-4975-4cff-b1dd-4d707638966e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:38.744841 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6f1c296c-4975-4cff-b1dd-4d707638966e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:38.745283 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6f1c296c-4975-4cff-b1dd-4d707638966e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:38.821419 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6f1c296c-4975-4cff-b1dd-4d707638966e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:38.834198 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6f1c296c-4975-4cff-b1dd-4d707638966e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1327 microversion: 2.1 time: 0.103979 Jun 16 14:59:38.835077 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 304/606] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:38 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:39.493297 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c442eed1-7dcb-4f47-8df8-7b9af61b9cf1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:39.495081 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c442eed1-7dcb-4f47-8df8-7b9af61b9cf1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:39.504780 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c442eed1-7dcb-4f47-8df8-7b9af61b9cf1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:39.506754 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c442eed1-7dcb-4f47-8df8-7b9af61b9cf1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:39.507578 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c442eed1-7dcb-4f47-8df8-7b9af61b9cf1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:39.508118 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c442eed1-7dcb-4f47-8df8-7b9af61b9cf1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:39.694619 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c442eed1-7dcb-4f47-8df8-7b9af61b9cf1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:39.704453 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c442eed1-7dcb-4f47-8df8-7b9af61b9cf1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:39.706008 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c442eed1-7dcb-4f47-8df8-7b9af61b9cf1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:39.707389 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c442eed1-7dcb-4f47-8df8-7b9af61b9cf1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.219203 Jun 16 14:59:39.708216 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 303/607] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:39 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:59:39.863291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-38dd748f-42d9-4cad-a3c0-c0f189892fbf tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:39.863979 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-38dd748f-42d9-4cad-a3c0-c0f189892fbf tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:39.872465 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-38dd748f-42d9-4cad-a3c0-c0f189892fbf tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:39.873116 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-38dd748f-42d9-4cad-a3c0-c0f189892fbf tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:39.873994 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-38dd748f-42d9-4cad-a3c0-c0f189892fbf tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:39.874435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-38dd748f-42d9-4cad-a3c0-c0f189892fbf tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:39.958262 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-38dd748f-42d9-4cad-a3c0-c0f189892fbf tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:39.975431 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-38dd748f-42d9-4cad-a3c0-c0f189892fbf tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1327 microversion: 2.1 time: 0.116010 Jun 16 14:59:39.976679 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 305/608] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:39 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1327 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:40.726422 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1a3f7552-494c-4a4f-a5de-9727d9f804f4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:40.727068 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-1a3f7552-494c-4a4f-a5de-9727d9f804f4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:40.729019 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=4 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:40.736911 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1a3f7552-494c-4a4f-a5de-9727d9f804f4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:40.737414 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1a3f7552-494c-4a4f-a5de-9727d9f804f4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:40.738667 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1a3f7552-494c-4a4f-a5de-9727d9f804f4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:40.739201 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1a3f7552-494c-4a4f-a5de-9727d9f804f4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:40.928320 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1a3f7552-494c-4a4f-a5de-9727d9f804f4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:40.949384 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1a3f7552-494c-4a4f-a5de-9727d9f804f4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:40.952959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1a3f7552-494c-4a4f-a5de-9727d9f804f4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:40.955388 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1a3f7552-494c-4a4f-a5de-9727d9f804f4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.232615 Jun 16 14:59:40.956392 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 304/609] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:40 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:41.000929 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b9a3ae58-9a6f-4da4-b3bc-2ca74565df00 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:41.001596 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b9a3ae58-9a6f-4da4-b3bc-2ca74565df00 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:41.009817 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b9a3ae58-9a6f-4da4-b3bc-2ca74565df00 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:41.010358 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b9a3ae58-9a6f-4da4-b3bc-2ca74565df00 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:41.011441 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b9a3ae58-9a6f-4da4-b3bc-2ca74565df00 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:41.012085 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b9a3ae58-9a6f-4da4-b3bc-2ca74565df00 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:41.093369 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b9a3ae58-9a6f-4da4-b3bc-2ca74565df00 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:41.102391 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b9a3ae58-9a6f-4da4-b3bc-2ca74565df00 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1327 microversion: 2.1 time: 0.105845 Jun 16 14:59:41.103176 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 306/610] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:40 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:41.976928 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d00e02b7-5c8e-4b0d-ad24-c0c2c97d06c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:41.977549 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d00e02b7-5c8e-4b0d-ad24-c0c2c97d06c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:41.987372 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d00e02b7-5c8e-4b0d-ad24-c0c2c97d06c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:41.988138 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d00e02b7-5c8e-4b0d-ad24-c0c2c97d06c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:41.989111 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d00e02b7-5c8e-4b0d-ad24-c0c2c97d06c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:41.989846 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d00e02b7-5c8e-4b0d-ad24-c0c2c97d06c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:42.119852 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1c12868d-bfd2-4ac4-ab97-cba4e0dcbea7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:42.121813 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1c12868d-bfd2-4ac4-ab97-cba4e0dcbea7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:42.129167 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1c12868d-bfd2-4ac4-ab97-cba4e0dcbea7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:42.130090 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1c12868d-bfd2-4ac4-ab97-cba4e0dcbea7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:42.131008 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1c12868d-bfd2-4ac4-ab97-cba4e0dcbea7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:42.131555 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1c12868d-bfd2-4ac4-ab97-cba4e0dcbea7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:42.178705 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d00e02b7-5c8e-4b0d-ad24-c0c2c97d06c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:42.196808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d00e02b7-5c8e-4b0d-ad24-c0c2c97d06c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:42.198834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d00e02b7-5c8e-4b0d-ad24-c0c2c97d06c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:42.200820 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d00e02b7-5c8e-4b0d-ad24-c0c2c97d06c1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.227435 Jun 16 14:59:42.201566 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 305/611] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:41 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:42.224905 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1c12868d-bfd2-4ac4-ab97-cba4e0dcbea7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:42.234386 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1c12868d-bfd2-4ac4-ab97-cba4e0dcbea7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1327 microversion: 2.1 time: 0.118360 Jun 16 14:59:42.234838 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 307/612] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:42 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1327 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:43.228258 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-02e9ddf8-3a6b-4d3b-8b40-0dcfec756ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:43.228894 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-02e9ddf8-3a6b-4d3b-8b40-0dcfec756ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:43.238804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-02e9ddf8-3a6b-4d3b-8b40-0dcfec756ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:43.239572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-02e9ddf8-3a6b-4d3b-8b40-0dcfec756ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:43.240929 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-02e9ddf8-3a6b-4d3b-8b40-0dcfec756ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:43.241681 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-02e9ddf8-3a6b-4d3b-8b40-0dcfec756ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:43.252292 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ffc75601-3e91-4561-be4e-fbca2a3ca31e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:43.252934 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ffc75601-3e91-4561-be4e-fbca2a3ca31e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:43.263209 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ffc75601-3e91-4561-be4e-fbca2a3ca31e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:43.263807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ffc75601-3e91-4561-be4e-fbca2a3ca31e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:43.264453 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ffc75601-3e91-4561-be4e-fbca2a3ca31e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:43.264902 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ffc75601-3e91-4561-be4e-fbca2a3ca31e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:43.359746 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ffc75601-3e91-4561-be4e-fbca2a3ca31e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:43.373146 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ffc75601-3e91-4561-be4e-fbca2a3ca31e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1327 microversion: 2.1 time: 0.124711 Jun 16 14:59:43.375728 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 308/613] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:43 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1327 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:43.481133 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-02e9ddf8-3a6b-4d3b-8b40-0dcfec756ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:43.500709 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-02e9ddf8-3a6b-4d3b-8b40-0dcfec756ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:43.502366 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-02e9ddf8-3a6b-4d3b-8b40-0dcfec756ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:43.513880 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-02e9ddf8-3a6b-4d3b-8b40-0dcfec756ab1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.291893 Jun 16 14:59:43.531931 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 306/614] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:43 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:44.395362 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7e9c24f7-2e36-4091-bbbf-46cdee7bc2ac tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:44.396315 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7e9c24f7-2e36-4091-bbbf-46cdee7bc2ac tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:44.404414 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e9c24f7-2e36-4091-bbbf-46cdee7bc2ac tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:44.405397 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e9c24f7-2e36-4091-bbbf-46cdee7bc2ac tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:44.405915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e9c24f7-2e36-4091-bbbf-46cdee7bc2ac tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:44.406352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e9c24f7-2e36-4091-bbbf-46cdee7bc2ac tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:44.487387 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7e9c24f7-2e36-4091-bbbf-46cdee7bc2ac tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:44.495124 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7e9c24f7-2e36-4091-bbbf-46cdee7bc2ac tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1327 microversion: 2.1 time: 0.104054 Jun 16 14:59:44.495787 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 309/615] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:44 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:44.543040 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1ae32a3f-74a8-4a6c-bf2b-1e7bcb8d6e0e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:44.544351 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-1ae32a3f-74a8-4a6c-bf2b-1e7bcb8d6e0e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:44.550805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1ae32a3f-74a8-4a6c-bf2b-1e7bcb8d6e0e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:44.551255 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1ae32a3f-74a8-4a6c-bf2b-1e7bcb8d6e0e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:44.552222 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1ae32a3f-74a8-4a6c-bf2b-1e7bcb8d6e0e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:44.552796 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1ae32a3f-74a8-4a6c-bf2b-1e7bcb8d6e0e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:44.721553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1ae32a3f-74a8-4a6c-bf2b-1e7bcb8d6e0e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:44.731873 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1ae32a3f-74a8-4a6c-bf2b-1e7bcb8d6e0e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:44.733430 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1ae32a3f-74a8-4a6c-bf2b-1e7bcb8d6e0e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:44.734674 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1ae32a3f-74a8-4a6c-bf2b-1e7bcb8d6e0e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.195664 Jun 16 14:59:44.735167 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 307/616] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:44 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:45.513059 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-640ba1af-bb77-485c-80e9-68a82a1c3e39 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:45.513692 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-640ba1af-bb77-485c-80e9-68a82a1c3e39 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:45.520879 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-640ba1af-bb77-485c-80e9-68a82a1c3e39 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:45.521328 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-640ba1af-bb77-485c-80e9-68a82a1c3e39 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:45.522096 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-640ba1af-bb77-485c-80e9-68a82a1c3e39 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:45.522583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-640ba1af-bb77-485c-80e9-68a82a1c3e39 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:45.543338 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=100 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:45.593179 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-640ba1af-bb77-485c-80e9-68a82a1c3e39 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:45.602945 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-640ba1af-bb77-485c-80e9-68a82a1c3e39 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1327 microversion: 2.1 time: 0.093613 Jun 16 14:59:45.603850 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 310/617] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:45 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:45.752760 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-726a2b77-1093-40f9-be6a-5a6337aaac3d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:45.753387 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-726a2b77-1093-40f9-be6a-5a6337aaac3d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:45.759640 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-726a2b77-1093-40f9-be6a-5a6337aaac3d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:45.760602 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-726a2b77-1093-40f9-be6a-5a6337aaac3d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:45.761660 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-726a2b77-1093-40f9-be6a-5a6337aaac3d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:45.762090 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-726a2b77-1093-40f9-be6a-5a6337aaac3d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:45.961535 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-726a2b77-1093-40f9-be6a-5a6337aaac3d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:45.975113 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-726a2b77-1093-40f9-be6a-5a6337aaac3d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:45.976675 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-726a2b77-1093-40f9-be6a-5a6337aaac3d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:45.978044 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-726a2b77-1093-40f9-be6a-5a6337aaac3d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.229247 Jun 16 14:59:45.983302 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 308/618] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:45 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:46.622850 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-433a94cf-5871-4a7c-84c7-bf6efac2df81 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:46.623499 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-433a94cf-5871-4a7c-84c7-bf6efac2df81 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:46.630404 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-433a94cf-5871-4a7c-84c7-bf6efac2df81 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:46.630859 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-433a94cf-5871-4a7c-84c7-bf6efac2df81 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:46.631650 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-433a94cf-5871-4a7c-84c7-bf6efac2df81 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:46.632118 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-433a94cf-5871-4a7c-84c7-bf6efac2df81 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:46.698512 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-433a94cf-5871-4a7c-84c7-bf6efac2df81 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:46.712484 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-433a94cf-5871-4a7c-84c7-bf6efac2df81 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1327 microversion: 2.1 time: 0.094571 Jun 16 14:59:46.714209 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 311/619] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:46 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:47.004222 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-75de3257-2510-465a-8081-973f58b4bd57 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:47.004698 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-75de3257-2510-465a-8081-973f58b4bd57 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:47.011063 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-75de3257-2510-465a-8081-973f58b4bd57 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:47.011783 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-75de3257-2510-465a-8081-973f58b4bd57 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:47.012934 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-75de3257-2510-465a-8081-973f58b4bd57 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:47.013036 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-75de3257-2510-465a-8081-973f58b4bd57 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:47.156655 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-75de3257-2510-465a-8081-973f58b4bd57 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:47.166065 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-75de3257-2510-465a-8081-973f58b4bd57 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:47.167556 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-75de3257-2510-465a-8081-973f58b4bd57 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:47.169382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-75de3257-2510-465a-8081-973f58b4bd57 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.168927 Jun 16 14:59:47.169935 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 309/620] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:46 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:47.730404 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4eaf58ae-d15c-4dc7-acc6-79b2ec8dd02c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:47.731123 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4eaf58ae-d15c-4dc7-acc6-79b2ec8dd02c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:47.737731 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4eaf58ae-d15c-4dc7-acc6-79b2ec8dd02c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:47.738172 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4eaf58ae-d15c-4dc7-acc6-79b2ec8dd02c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:47.738936 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4eaf58ae-d15c-4dc7-acc6-79b2ec8dd02c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:47.739363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4eaf58ae-d15c-4dc7-acc6-79b2ec8dd02c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:47.774722 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4eaf58ae-d15c-4dc7-acc6-79b2ec8dd02c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:47.775156 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4eaf58ae-d15c-4dc7-acc6-79b2ec8dd02c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:47.775601 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-4eaf58ae-d15c-4dc7-acc6-79b2ec8dd02c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lazy-loading 'fault' on Instance uuid 36bbbe9f-1cae-453f-9d25-38654f3e30a8 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:59:47.821853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4eaf58ae-d15c-4dc7-acc6-79b2ec8dd02c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:47.830030 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4eaf58ae-d15c-4dc7-acc6-79b2ec8dd02c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1332 microversion: 2.1 time: 0.103473 Jun 16 14:59:47.830605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 312/621] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:47 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:48.189451 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-aaaaeb53-4b40-484e-9dbc-1e1b4610f756 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:48.190099 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-aaaaeb53-4b40-484e-9dbc-1e1b4610f756 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:48.196192 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aaaaeb53-4b40-484e-9dbc-1e1b4610f756 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:48.196654 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aaaaeb53-4b40-484e-9dbc-1e1b4610f756 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:48.197414 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aaaaeb53-4b40-484e-9dbc-1e1b4610f756 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:48.197928 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aaaaeb53-4b40-484e-9dbc-1e1b4610f756 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:48.337574 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-aaaaeb53-4b40-484e-9dbc-1e1b4610f756 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:48.346351 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-aaaaeb53-4b40-484e-9dbc-1e1b4610f756 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:48.347907 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-aaaaeb53-4b40-484e-9dbc-1e1b4610f756 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:48.349208 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-aaaaeb53-4b40-484e-9dbc-1e1b4610f756 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.164484 Jun 16 14:59:48.350087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 310/622] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:48 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:48.847883 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-75d4808d-3eb5-4572-a26e-dfccfbc51634 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:48.848496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-75d4808d-3eb5-4572-a26e-dfccfbc51634 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:48.857072 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75d4808d-3eb5-4572-a26e-dfccfbc51634 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:48.857629 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75d4808d-3eb5-4572-a26e-dfccfbc51634 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:48.858766 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75d4808d-3eb5-4572-a26e-dfccfbc51634 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:48.859395 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75d4808d-3eb5-4572-a26e-dfccfbc51634 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:48.896429 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75d4808d-3eb5-4572-a26e-dfccfbc51634 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:48.896877 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75d4808d-3eb5-4572-a26e-dfccfbc51634 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:48.897335 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-75d4808d-3eb5-4572-a26e-dfccfbc51634 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lazy-loading 'fault' on Instance uuid 36bbbe9f-1cae-453f-9d25-38654f3e30a8 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:59:48.940649 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-75d4808d-3eb5-4572-a26e-dfccfbc51634 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:48.951070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-75d4808d-3eb5-4572-a26e-dfccfbc51634 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1332 microversion: 2.1 time: 0.106994 Jun 16 14:59:48.951655 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 313/623] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:48 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:49.369095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-805b35c4-5d6f-4360-aff5-c58d9e7541df tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:49.369727 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-805b35c4-5d6f-4360-aff5-c58d9e7541df tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:49.376434 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-805b35c4-5d6f-4360-aff5-c58d9e7541df tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:49.376880 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-805b35c4-5d6f-4360-aff5-c58d9e7541df tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:49.377633 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-805b35c4-5d6f-4360-aff5-c58d9e7541df tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:49.378058 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-805b35c4-5d6f-4360-aff5-c58d9e7541df tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:49.536076 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-805b35c4-5d6f-4360-aff5-c58d9e7541df tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:49.546125 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-805b35c4-5d6f-4360-aff5-c58d9e7541df tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:49.547623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-805b35c4-5d6f-4360-aff5-c58d9e7541df tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:49.548826 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-805b35c4-5d6f-4360-aff5-c58d9e7541df tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.184089 Jun 16 14:59:49.549388 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 311/624] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:49 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:59:49.968774 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-864896cd-366d-4ebb-8b99-8ab61e2a09bd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:49.969383 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-864896cd-366d-4ebb-8b99-8ab61e2a09bd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:49.976151 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-864896cd-366d-4ebb-8b99-8ab61e2a09bd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:49.976594 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-864896cd-366d-4ebb-8b99-8ab61e2a09bd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:49.977350 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-864896cd-366d-4ebb-8b99-8ab61e2a09bd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:49.977809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-864896cd-366d-4ebb-8b99-8ab61e2a09bd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:50.010725 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-864896cd-366d-4ebb-8b99-8ab61e2a09bd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:50.011171 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-864896cd-366d-4ebb-8b99-8ab61e2a09bd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:50.011615 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-864896cd-366d-4ebb-8b99-8ab61e2a09bd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lazy-loading 'fault' on Instance uuid 36bbbe9f-1cae-453f-9d25-38654f3e30a8 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:59:50.062529 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-864896cd-366d-4ebb-8b99-8ab61e2a09bd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:50.073956 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-864896cd-366d-4ebb-8b99-8ab61e2a09bd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 200 len: 1332 microversion: 2.1 time: 0.109034 Jun 16 14:59:50.075971 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 314/625] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:49 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 1332 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:50.567805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7d171fc1-267d-4b6a-8c50-bf5542484fbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:50.568596 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7d171fc1-267d-4b6a-8c50-bf5542484fbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:50.574826 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7d171fc1-267d-4b6a-8c50-bf5542484fbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:50.575268 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7d171fc1-267d-4b6a-8c50-bf5542484fbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:50.576070 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7d171fc1-267d-4b6a-8c50-bf5542484fbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:50.576502 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7d171fc1-267d-4b6a-8c50-bf5542484fbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:50.613655 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8b883406-22fa-408d-96f6-3bb80b8ee4af tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-469495300", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-293733398", "security_groups": [{"name": "tempest-secgroup-smoke-1651829026"}], "networks": [{"uuid": "bb54bdcc-f56f-43d6-99ac-2878f604f106"}], "block_device_mapping_v2": [{"uuid": "be672f99-44c3-4259-9092-afb87c2a4266", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:50.810078 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7d171fc1-267d-4b6a-8c50-bf5542484fbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:50.818657 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7d171fc1-267d-4b6a-8c50-bf5542484fbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:50.820175 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7d171fc1-267d-4b6a-8c50-bf5542484fbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:50.821338 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7d171fc1-267d-4b6a-8c50-bf5542484fbe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.257506 Jun 16 14:59:50.821894 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 312/626] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:50 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:50.832129 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-8b883406-22fa-408d-96f6-3bb80b8ee4af tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] validate_networks() for [('bb54bdcc-f56f-43d6-99ac-2878f604f106', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:59:51.094061 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a28abbb0-2187-4b03-99fc-45ca0ded3502 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:51.094583 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a28abbb0-2187-4b03-99fc-45ca0ded3502 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:51.100559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a28abbb0-2187-4b03-99fc-45ca0ded3502 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:51.101012 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a28abbb0-2187-4b03-99fc-45ca0ded3502 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:51.101846 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a28abbb0-2187-4b03-99fc-45ca0ded3502 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:51.102292 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a28abbb0-2187-4b03-99fc-45ca0ded3502 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:51.116853 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-a28abbb0-2187-4b03-99fc-45ca0ded3502 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] HTTP exception thrown: Instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 could not be found. Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a28abbb0-2187-4b03-99fc-45ca0ded3502 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Request method failure captured: Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 HTTP/1.1 Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0RvgNnHERAvlrn1WvFUUcvodkCzzgEgc9uA3Ra8J3x-gaqNyXJgZlXW9Fu3DW2tOgMnX7C8vwaaaUd2R9Mf98qk7wOTE2lojDUYY_ofhKl3QsPjUp0j-B30CwpTfHwGiZa1GU9kj2dLQMYLnA0B8U66Nc60nNiPBn1l71iNpcPmPQ4 Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 14:59:51.118506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 14:59:51.120243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_60ade68614ac4730a35c9958123d06e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 14:59:51.120243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 14:59:51.120243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 14:59:51.120243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 14:59:51.120243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 14:59:51.120243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 14:59:51.120243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 14:59:51.120243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: 87a6ec62b5414930bf36f69f072d7df6 Jun 16 14:59:51.120243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 14:59:51.120243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 14:59:51.120243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 could not be found. Jun 16 14:59:51.120243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': '36bbbe9f-1cae-453f-9d25-38654f3e30a8'} Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 could not be found. Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:59:51.121285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:59:51.122841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:59:51.122841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:59:51.122841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:59:51.122841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:59:51.122841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:59:51.122841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:59:51.122841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:59:51.122841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 could not be found. Jun 16 14:59:51.122841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:59:51.122841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:59:51.122841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:59:51.122841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:51.122841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:59:51.122841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:59:51.122841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:59:51.122841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:59:51.122841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 could not be found. Jun 16 14:59:51.122841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 14:59:51.124345 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a28abbb0-2187-4b03-99fc-45ca0ded3502 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Returning 404 to user: Instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:59:51.124345 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a28abbb0-2187-4b03-99fc-45ca0ded3502 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 404 len: 111 microversion: 2.1 time: 0.030543 Jun 16 14:59:51.124345 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 313/627] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:51 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 14:59:51.128893 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-cbfd25e2-e652-4d44-9c20-ac15f541f49e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '.version_select at 0x7f33e131d0d0>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:51.148583 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-cbfd25e2-e652-4d44-9c20-ac15f541f49e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680252146" status: 202 len: 0 microversion: 2.1 time: 0.023225 Jun 16 14:59:51.149152 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 314/628] 10.222.0.76 () {58 vars in 1220 bytes} [Thu Jun 16 14:59:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680252146 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 14:59:51.240965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-8b883406-22fa-408d-96f6-3bb80b8ee4af tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:59:51.241434 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-8b883406-22fa-408d-96f6-3bb80b8ee4af tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:59:51.241842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-8b883406-22fa-408d-96f6-3bb80b8ee4af tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:59:51.242305 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-8b883406-22fa-408d-96f6-3bb80b8ee4af tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:59:51.242712 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-8b883406-22fa-408d-96f6-3bb80b8ee4af tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:59:51.251732 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8b883406-22fa-408d-96f6-3bb80b8ee4af tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:51.252183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8b883406-22fa-408d-96f6-3bb80b8ee4af tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:51.252972 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8b883406-22fa-408d-96f6-3bb80b8ee4af tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:51.253411 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8b883406-22fa-408d-96f6-3bb80b8ee4af tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:51.270285 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-8b883406-22fa-408d-96f6-3bb80b8ee4af tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Getting quotas for project 646f903869dd413b839067743f25278c. Resources: {'ram', 'cores', 'instances'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:59:51.274258 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-8b883406-22fa-408d-96f6-3bb80b8ee4af tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Getting quotas for user 9f943a0852a74679b940f20a87f15d71 and project 646f903869dd413b839067743f25278c. Resources: {'ram', 'cores', 'instances'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:59:51.341732 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8b883406-22fa-408d-96f6-3bb80b8ee4af tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:59:51.344256 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8b883406-22fa-408d-96f6-3bb80b8ee4af tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='be672f99-44c3-4259-9092-afb87c2a4266',volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:59:51.478650 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8b883406-22fa-408d-96f6-3bb80b8ee4af tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.872668 Jun 16 14:59:51.480085 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 315/629] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 14:59:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:59:51.490226 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f945c8bd-f182-49cf-9e4d-594e7481d40b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:51.491106 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f945c8bd-f182-49cf-9e4d-594e7481d40b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:51.570904 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f945c8bd-f182-49cf-9e4d-594e7481d40b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:51.597069 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f945c8bd-f182-49cf-9e4d-594e7481d40b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1087 microversion: 2.1 time: 0.111155 Jun 16 14:59:51.597584 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 315/630] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:51 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1087 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:51.841012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c7a340c3-04fb-4e97-83cd-6ab214d9dc62 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:51.841587 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c7a340c3-04fb-4e97-83cd-6ab214d9dc62 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:51.849105 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7a340c3-04fb-4e97-83cd-6ab214d9dc62 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:51.849661 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7a340c3-04fb-4e97-83cd-6ab214d9dc62 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:51.850639 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7a340c3-04fb-4e97-83cd-6ab214d9dc62 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:51.851367 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7a340c3-04fb-4e97-83cd-6ab214d9dc62 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:51.910707 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f7b6a53b-26a0-4ec6-8e21-e7ffbb8d0dd6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:51.911196 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f7b6a53b-26a0-4ec6-8e21-e7ffbb8d0dd6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:51.917150 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f7b6a53b-26a0-4ec6-8e21-e7ffbb8d0dd6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:51.917603 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f7b6a53b-26a0-4ec6-8e21-e7ffbb8d0dd6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:51.918373 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f7b6a53b-26a0-4ec6-8e21-e7ffbb8d0dd6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:51.919301 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f7b6a53b-26a0-4ec6-8e21-e7ffbb8d0dd6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:51.923377 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=100 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:51.992855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c7a340c3-04fb-4e97-83cd-6ab214d9dc62 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:52.001116 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.objects.instance [None req-f7b6a53b-26a0-4ec6-8e21-e7ffbb8d0dd6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lazy-loading 'services' on Instance uuid fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 {{(pid=117443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:59:52.002014 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c7a340c3-04fb-4e97-83cd-6ab214d9dc62 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:52.003569 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c7a340c3-04fb-4e97-83cd-6ab214d9dc62 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:52.004776 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c7a340c3-04fb-4e97-83cd-6ab214d9dc62 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.168810 Jun 16 14:59:52.005328 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 316/631] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:51 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:52.075401 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f7b6a53b-26a0-4ec6-8e21-e7ffbb8d0dd6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "DELETE /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments/17712aaf-f87a-4a4c-ae2c-ca14dfebbc25" status: 202 len: 0 microversion: 2.1 time: 0.168877 Jun 16 14:59:52.078239 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 316/632] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Jun 16 14:59:51 2022] DELETE /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments/17712aaf-f87a-4a4c-ae2c-ca14dfebbc25 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 14:59:52.088534 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-01bf6454-2fbf-4e23-950b-7882ba1e9ec1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:52.089517 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-01bf6454-2fbf-4e23-950b-7882ba1e9ec1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:52.095560 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01bf6454-2fbf-4e23-950b-7882ba1e9ec1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:52.096039 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01bf6454-2fbf-4e23-950b-7882ba1e9ec1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:52.096803 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01bf6454-2fbf-4e23-950b-7882ba1e9ec1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:52.097230 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01bf6454-2fbf-4e23-950b-7882ba1e9ec1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:52.127635 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-01bf6454-2fbf-4e23-950b-7882ba1e9ec1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043110 Jun 16 14:59:52.128214 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 317/633] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 14:59:52 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:59:52.614403 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3066ef67-3254-427c-946d-be47eebe8a72 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:52.615089 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-3066ef67-3254-427c-946d-be47eebe8a72 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:52.622002 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3066ef67-3254-427c-946d-be47eebe8a72 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:52.622443 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3066ef67-3254-427c-946d-be47eebe8a72 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:52.623212 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3066ef67-3254-427c-946d-be47eebe8a72 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:52.623634 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3066ef67-3254-427c-946d-be47eebe8a72 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:52.688108 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3066ef67-3254-427c-946d-be47eebe8a72 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:52.696328 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3066ef67-3254-427c-946d-be47eebe8a72 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1137 microversion: 2.1 time: 0.086251 Jun 16 14:59:52.696876 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 317/634] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:52 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:53.023007 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-baec7cb9-5c90-45af-acb3-e824c11f52fc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:53.023604 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-baec7cb9-5c90-45af-acb3-e824c11f52fc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:53.030594 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-baec7cb9-5c90-45af-acb3-e824c11f52fc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:53.031039 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-baec7cb9-5c90-45af-acb3-e824c11f52fc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:53.032073 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-baec7cb9-5c90-45af-acb3-e824c11f52fc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:53.032501 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-baec7cb9-5c90-45af-acb3-e824c11f52fc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:53.140040 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-18939129-d3d6-48da-8996-1880d9b7393a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:53.141015 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-18939129-d3d6-48da-8996-1880d9b7393a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:53.147540 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-18939129-d3d6-48da-8996-1880d9b7393a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:53.148021 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-18939129-d3d6-48da-8996-1880d9b7393a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:53.148795 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-18939129-d3d6-48da-8996-1880d9b7393a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:53.149226 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-18939129-d3d6-48da-8996-1880d9b7393a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:53.165107 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-baec7cb9-5c90-45af-acb3-e824c11f52fc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:53.173522 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-baec7cb9-5c90-45af-acb3-e824c11f52fc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:53.175020 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-baec7cb9-5c90-45af-acb3-e824c11f52fc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:53.176210 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-baec7cb9-5c90-45af-acb3-e824c11f52fc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.157168 Jun 16 14:59:53.176768 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 318/635] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:53 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:53.179191 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-18939129-d3d6-48da-8996-1880d9b7393a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043784 Jun 16 14:59:53.179794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 318/636] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 14:59:53 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:59:53.712893 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c9f0ac8f-49af-49b7-ab2b-a6f88e9dd7d9 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:53.713506 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c9f0ac8f-49af-49b7-ab2b-a6f88e9dd7d9 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:53.720317 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c9f0ac8f-49af-49b7-ab2b-a6f88e9dd7d9 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:53.720771 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c9f0ac8f-49af-49b7-ab2b-a6f88e9dd7d9 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:53.721566 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c9f0ac8f-49af-49b7-ab2b-a6f88e9dd7d9 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:53.722095 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c9f0ac8f-49af-49b7-ab2b-a6f88e9dd7d9 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:53.782691 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c9f0ac8f-49af-49b7-ab2b-a6f88e9dd7d9 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:53.790202 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c9f0ac8f-49af-49b7-ab2b-a6f88e9dd7d9 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1137 microversion: 2.1 time: 0.081169 Jun 16 14:59:53.790757 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 319/637] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:53 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1137 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:54.192045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-51ec3d85-ccd7-4efd-a599-6a86343ce92c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:54.192961 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-51ec3d85-ccd7-4efd-a599-6a86343ce92c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:54.195054 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4beef31e-fd3d-462f-b55c-6ffc2b5af1e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:54.195789 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4beef31e-fd3d-462f-b55c-6ffc2b5af1e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:54.199369 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-51ec3d85-ccd7-4efd-a599-6a86343ce92c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:54.200411 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-51ec3d85-ccd7-4efd-a599-6a86343ce92c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:54.201200 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-51ec3d85-ccd7-4efd-a599-6a86343ce92c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:54.201729 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-51ec3d85-ccd7-4efd-a599-6a86343ce92c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:54.203210 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4beef31e-fd3d-462f-b55c-6ffc2b5af1e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:54.203656 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4beef31e-fd3d-462f-b55c-6ffc2b5af1e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:54.204653 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4beef31e-fd3d-462f-b55c-6ffc2b5af1e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:54.205091 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4beef31e-fd3d-462f-b55c-6ffc2b5af1e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:54.233647 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-51ec3d85-ccd7-4efd-a599-6a86343ce92c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045638 Jun 16 14:59:54.234413 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 319/638] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 14:59:54 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:59:54.340656 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4beef31e-fd3d-462f-b55c-6ffc2b5af1e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:54.357101 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4beef31e-fd3d-462f-b55c-6ffc2b5af1e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:54.358715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4beef31e-fd3d-462f-b55c-6ffc2b5af1e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:54.359916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4beef31e-fd3d-462f-b55c-6ffc2b5af1e1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.168780 Jun 16 14:59:54.360477 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 320/639] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:54 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:59:54.806727 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ec5dbf36-8302-4eb8-8140-a788e32f85e0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:54.807320 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ec5dbf36-8302-4eb8-8140-a788e32f85e0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:54.813824 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ec5dbf36-8302-4eb8-8140-a788e32f85e0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:54.814207 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ec5dbf36-8302-4eb8-8140-a788e32f85e0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:54.814948 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ec5dbf36-8302-4eb8-8140-a788e32f85e0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:54.815380 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ec5dbf36-8302-4eb8-8140-a788e32f85e0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:54.877571 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ec5dbf36-8302-4eb8-8140-a788e32f85e0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:54.884923 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ec5dbf36-8302-4eb8-8140-a788e32f85e0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1185 microversion: 2.1 time: 0.082145 Jun 16 14:59:54.885475 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 320/640] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:54 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:55.246630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e4583412-5c25-43be-9776-ffefb0d5c968 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:55.248418 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e4583412-5c25-43be-9776-ffefb0d5c968 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:55.254845 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e4583412-5c25-43be-9776-ffefb0d5c968 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:55.255302 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e4583412-5c25-43be-9776-ffefb0d5c968 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:55.256662 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e4583412-5c25-43be-9776-ffefb0d5c968 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:55.257230 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e4583412-5c25-43be-9776-ffefb0d5c968 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:55.289319 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e4583412-5c25-43be-9776-ffefb0d5c968 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046730 Jun 16 14:59:55.289890 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 321/641] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 14:59:55 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:59:55.378900 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-abef2cc6-a4f7-4225-8d51-f41268cf5d13 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:55.379672 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-abef2cc6-a4f7-4225-8d51-f41268cf5d13 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:55.385849 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-abef2cc6-a4f7-4225-8d51-f41268cf5d13 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:55.386292 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-abef2cc6-a4f7-4225-8d51-f41268cf5d13 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:55.387049 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-abef2cc6-a4f7-4225-8d51-f41268cf5d13 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:55.387481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-abef2cc6-a4f7-4225-8d51-f41268cf5d13 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:55.516170 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-abef2cc6-a4f7-4225-8d51-f41268cf5d13 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:55.524645 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-abef2cc6-a4f7-4225-8d51-f41268cf5d13 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:55.526178 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-abef2cc6-a4f7-4225-8d51-f41268cf5d13 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:55.527330 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-abef2cc6-a4f7-4225-8d51-f41268cf5d13 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.152648 Jun 16 14:59:55.528443 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 321/642] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:55 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:55.902884 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0ef9bd08-4354-4660-ac01-1420870c5260 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:55.903485 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0ef9bd08-4354-4660-ac01-1420870c5260 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:55.909784 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0ef9bd08-4354-4660-ac01-1420870c5260 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:55.910234 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0ef9bd08-4354-4660-ac01-1420870c5260 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:55.910995 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0ef9bd08-4354-4660-ac01-1420870c5260 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:55.911425 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0ef9bd08-4354-4660-ac01-1420870c5260 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:55.981921 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0ef9bd08-4354-4660-ac01-1420870c5260 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:55.989707 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0ef9bd08-4354-4660-ac01-1420870c5260 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1193 microversion: 2.1 time: 0.090686 Jun 16 14:59:55.990277 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 322/643] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:55 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:56.300859 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-75c4e96e-4441-4067-a85f-930c54a3d341 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:56.301776 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-75c4e96e-4441-4067-a85f-930c54a3d341 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:56.307867 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-75c4e96e-4441-4067-a85f-930c54a3d341 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:56.308317 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-75c4e96e-4441-4067-a85f-930c54a3d341 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:56.309641 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-75c4e96e-4441-4067-a85f-930c54a3d341 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:56.310088 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-75c4e96e-4441-4067-a85f-930c54a3d341 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:56.339146 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-75c4e96e-4441-4067-a85f-930c54a3d341 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042170 Jun 16 14:59:56.339920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 322/644] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 14:59:56 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:59:56.547422 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-04610f5c-c586-436d-8288-e52542f1f24b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:56.548057 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-04610f5c-c586-436d-8288-e52542f1f24b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:56.554576 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-04610f5c-c586-436d-8288-e52542f1f24b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:56.554960 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-04610f5c-c586-436d-8288-e52542f1f24b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:56.555732 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-04610f5c-c586-436d-8288-e52542f1f24b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:56.556165 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-04610f5c-c586-436d-8288-e52542f1f24b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:56.685270 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-04610f5c-c586-436d-8288-e52542f1f24b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:56.693737 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-04610f5c-c586-436d-8288-e52542f1f24b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:56.695286 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-04610f5c-c586-436d-8288-e52542f1f24b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:56.696472 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-04610f5c-c586-436d-8288-e52542f1f24b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.153976 Jun 16 14:59:56.697028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 323/645] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:56 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:57.006970 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e797ca68-4369-424e-9b80-74db314c14f6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:57.007582 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e797ca68-4369-424e-9b80-74db314c14f6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:57.014181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e797ca68-4369-424e-9b80-74db314c14f6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:57.014627 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e797ca68-4369-424e-9b80-74db314c14f6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:57.015374 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e797ca68-4369-424e-9b80-74db314c14f6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:57.015824 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e797ca68-4369-424e-9b80-74db314c14f6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:57.077151 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e797ca68-4369-424e-9b80-74db314c14f6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:57.084523 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e797ca68-4369-424e-9b80-74db314c14f6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1193 microversion: 2.1 time: 0.081385 Jun 16 14:59:57.085069 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 323/646] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:57 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:57.350870 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-75c607f8-b0f8-45b7-8e7b-59a986bcb446 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:57.351725 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-75c607f8-b0f8-45b7-8e7b-59a986bcb446 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:57.357722 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75c607f8-b0f8-45b7-8e7b-59a986bcb446 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:57.358166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75c607f8-b0f8-45b7-8e7b-59a986bcb446 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:57.358921 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75c607f8-b0f8-45b7-8e7b-59a986bcb446 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:57.359347 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75c607f8-b0f8-45b7-8e7b-59a986bcb446 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:57.391498 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-75c607f8-b0f8-45b7-8e7b-59a986bcb446 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044659 Jun 16 14:59:57.392078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 324/647] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 14:59:57 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:59:57.714907 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1d9e8ca0-ce31-4f8b-b95d-6cb66704efb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:57.716107 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-1d9e8ca0-ce31-4f8b-b95d-6cb66704efb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:57.722266 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1d9e8ca0-ce31-4f8b-b95d-6cb66704efb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:57.722728 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1d9e8ca0-ce31-4f8b-b95d-6cb66704efb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:57.723599 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1d9e8ca0-ce31-4f8b-b95d-6cb66704efb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:57.724067 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1d9e8ca0-ce31-4f8b-b95d-6cb66704efb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:57.858667 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1d9e8ca0-ce31-4f8b-b95d-6cb66704efb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:57.867217 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1d9e8ca0-ce31-4f8b-b95d-6cb66704efb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:57.868753 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1d9e8ca0-ce31-4f8b-b95d-6cb66704efb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:57.869899 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1d9e8ca0-ce31-4f8b-b95d-6cb66704efb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.158923 Jun 16 14:59:57.870468 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 324/648] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:57 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:59:58.103159 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b9665e42-09b4-40f6-98db-895ab0940adc tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:58.103601 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b9665e42-09b4-40f6-98db-895ab0940adc tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:58.110336 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b9665e42-09b4-40f6-98db-895ab0940adc tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:58.110791 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b9665e42-09b4-40f6-98db-895ab0940adc tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:58.111566 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b9665e42-09b4-40f6-98db-895ab0940adc tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:58.112038 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b9665e42-09b4-40f6-98db-895ab0940adc tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:58.179729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b9665e42-09b4-40f6-98db-895ab0940adc tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:58.187631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b9665e42-09b4-40f6-98db-895ab0940adc tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1203 microversion: 2.1 time: 0.089985 Jun 16 14:59:58.188205 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 325/649] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:58 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1203 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:58.403137 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a67a6582-11b5-4717-b25d-7c3710b353b3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:58.404075 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a67a6582-11b5-4717-b25d-7c3710b353b3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:58.410447 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a67a6582-11b5-4717-b25d-7c3710b353b3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:58.410895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a67a6582-11b5-4717-b25d-7c3710b353b3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:58.411645 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a67a6582-11b5-4717-b25d-7c3710b353b3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:58.412099 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a67a6582-11b5-4717-b25d-7c3710b353b3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:58.441800 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a67a6582-11b5-4717-b25d-7c3710b353b3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042583 Jun 16 14:59:58.442348 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 325/650] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 14:59:58 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:59:58.888202 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-35b50a40-f151-4d0f-91f3-afbc7229edb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:58.888819 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-35b50a40-f151-4d0f-91f3-afbc7229edb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:58.895631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-35b50a40-f151-4d0f-91f3-afbc7229edb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:58.896167 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-35b50a40-f151-4d0f-91f3-afbc7229edb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:58.897222 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-35b50a40-f151-4d0f-91f3-afbc7229edb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:58.897658 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-35b50a40-f151-4d0f-91f3-afbc7229edb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:59.049067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-35b50a40-f151-4d0f-91f3-afbc7229edb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:59.052630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=100 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:59.059576 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-35b50a40-f151-4d0f-91f3-afbc7229edb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:59.061133 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-35b50a40-f151-4d0f-91f3-afbc7229edb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:59.062295 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-35b50a40-f151-4d0f-91f3-afbc7229edb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.178004 Jun 16 14:59:59.062856 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 326/651] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 14:59:58 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:59:59.205340 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-0499a418-9e29-4354-aa1e-4d3c67c2790c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:59.206233 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-0499a418-9e29-4354-aa1e-4d3c67c2790c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:59.212480 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0499a418-9e29-4354-aa1e-4d3c67c2790c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:59.212929 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0499a418-9e29-4354-aa1e-4d3c67c2790c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:59.213701 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0499a418-9e29-4354-aa1e-4d3c67c2790c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:59.214137 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0499a418-9e29-4354-aa1e-4d3c67c2790c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:59.282495 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-0499a418-9e29-4354-aa1e-4d3c67c2790c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:59.291143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-0499a418-9e29-4354-aa1e-4d3c67c2790c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1203 microversion: 2.1 time: 0.090390 Jun 16 14:59:59.291967 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 326/652] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:59 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1203 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:59.453991 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d603fc35-6377-4339-8fc7-7cbf79f399d8 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:59.454828 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d603fc35-6377-4339-8fc7-7cbf79f399d8 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:59.457234 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:59.462395 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d603fc35-6377-4339-8fc7-7cbf79f399d8 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:59.462847 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d603fc35-6377-4339-8fc7-7cbf79f399d8 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:59.463614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d603fc35-6377-4339-8fc7-7cbf79f399d8 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:59.464089 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d603fc35-6377-4339-8fc7-7cbf79f399d8 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:59.494721 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d603fc35-6377-4339-8fc7-7cbf79f399d8 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044985 Jun 16 14:59:59.495267 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 327/653] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 14:59:59 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:00.081798 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-96cfec31-2655-446c-bcb7-8ad3475a0a26 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:00.082639 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-96cfec31-2655-446c-bcb7-8ad3475a0a26 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:00.100335 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:00.102718 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-96cfec31-2655-446c-bcb7-8ad3475a0a26 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:00.103169 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-96cfec31-2655-446c-bcb7-8ad3475a0a26 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:00.103969 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-96cfec31-2655-446c-bcb7-8ad3475a0a26 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:00.104424 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-96cfec31-2655-446c-bcb7-8ad3475a0a26 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:00.306998 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-96cfec31-2655-446c-bcb7-8ad3475a0a26 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:00.308670 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0886b9ea-a176-41a4-afe5-3b30773d8da6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:00.309433 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0886b9ea-a176-41a4-afe5-3b30773d8da6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:00.317212 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0886b9ea-a176-41a4-afe5-3b30773d8da6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:00.317719 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0886b9ea-a176-41a4-afe5-3b30773d8da6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:00.319373 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0886b9ea-a176-41a4-afe5-3b30773d8da6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:00.319857 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0886b9ea-a176-41a4-afe5-3b30773d8da6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:00.320157 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-96cfec31-2655-446c-bcb7-8ad3475a0a26 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:00.322171 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-96cfec31-2655-446c-bcb7-8ad3475a0a26 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:00.324658 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-96cfec31-2655-446c-bcb7-8ad3475a0a26 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.247376 Jun 16 15:00:00.327345 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 327/654] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:00:00 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:00:00.506900 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a33097a0-fb8f-4ea0-818e-e44211ccea27 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:00.507951 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a33097a0-fb8f-4ea0-818e-e44211ccea27 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:00.514616 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a33097a0-fb8f-4ea0-818e-e44211ccea27 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:00.515058 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a33097a0-fb8f-4ea0-818e-e44211ccea27 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:00.515864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a33097a0-fb8f-4ea0-818e-e44211ccea27 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:00.516293 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a33097a0-fb8f-4ea0-818e-e44211ccea27 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:00.547733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a33097a0-fb8f-4ea0-818e-e44211ccea27 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044773 Jun 16 15:00:00.548337 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 328/655] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:00:00 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 15:00:00.595842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0886b9ea-a176-41a4-afe5-3b30773d8da6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:00.609808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e3bc6c6c-ffca-468f-b534-9a400dd97003 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:00.610402 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e3bc6c6c-ffca-468f-b534-9a400dd97003 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:00.614577 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0886b9ea-a176-41a4-afe5-3b30773d8da6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1271 microversion: 2.1 time: 0.310334 Jun 16 15:00:00.625856 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 328/656] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:00 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1271 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:00.626079 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e3bc6c6c-ffca-468f-b534-9a400dd97003 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:00.626079 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e3bc6c6c-ffca-468f-b534-9a400dd97003 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:00.626079 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e3bc6c6c-ffca-468f-b534-9a400dd97003 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:00.626079 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e3bc6c6c-ffca-468f-b534-9a400dd97003 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:00.652594 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e3bc6c6c-ffca-468f-b534-9a400dd97003 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Going to try to terminate instance {{(pid=117443) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:00:00.742810 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e3bc6c6c-ffca-468f-b534-9a400dd97003 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "DELETE /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 204 len: 0 microversion: 2.1 time: 0.137092 Jun 16 15:00:00.743473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 329/657] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:00:00 2022] DELETE /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 15:00:00.756354 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0385781d-f29c-4489-a42d-18ba2d594ccb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:00.756904 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0385781d-f29c-4489-a42d-18ba2d594ccb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:00.766756 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0385781d-f29c-4489-a42d-18ba2d594ccb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:00.767786 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0385781d-f29c-4489-a42d-18ba2d594ccb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:00.768613 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0385781d-f29c-4489-a42d-18ba2d594ccb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:00.769057 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0385781d-f29c-4489-a42d-18ba2d594ccb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:01.120912 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0385781d-f29c-4489-a42d-18ba2d594ccb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:01.130102 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0385781d-f29c-4489-a42d-18ba2d594ccb tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1681 microversion: 2.1 time: 0.381188 Jun 16 15:00:01.141743 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 329/658] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:00 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1681 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:01.346408 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8c8e48de-18bf-402f-8d62-bfd181b7a643 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:01.347019 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-8c8e48de-18bf-402f-8d62-bfd181b7a643 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:01.354158 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c8e48de-18bf-402f-8d62-bfd181b7a643 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:01.355821 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c8e48de-18bf-402f-8d62-bfd181b7a643 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:01.356615 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c8e48de-18bf-402f-8d62-bfd181b7a643 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:01.359572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c8e48de-18bf-402f-8d62-bfd181b7a643 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:01.373993 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-b02f0ab5-c38d-459f-8f79-167766cf6933 req-b34953f0-e6b2-45e3-9913-29ea64f663c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c", "tag": "a38f8fd7-717d-49a5-8003-162021ff7c63"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:01.382571 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:01.385766 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=6 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:01.391436 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:01.392881 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-b02f0ab5-c38d-459f-8f79-167766cf6933 req-b34953f0-e6b2-45e3-9913-29ea64f663c6 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:01.394096 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-b02f0ab5-c38d-459f-8f79-167766cf6933 req-b34953f0-e6b2-45e3-9913-29ea64f663c6 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:01.414118 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-b02f0ab5-c38d-459f-8f79-167766cf6933 req-b34953f0-e6b2-45e3-9913-29ea64f663c6 service nova] Creating event network-changed:a38f8fd7-717d-49a5-8003-162021ff7c63 for instance 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c on hv-cinder-83716 Jun 16 15:00:01.430122 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-b02f0ab5-c38d-459f-8f79-167766cf6933 req-b34953f0-e6b2-45e3-9913-29ea64f663c6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060871 Jun 16 15:00:01.430732 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 330/659] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:01.530932 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-8c8e48de-18bf-402f-8d62-bfd181b7a643 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:01.540705 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-8c8e48de-18bf-402f-8d62-bfd181b7a643 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:01.542197 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-8c8e48de-18bf-402f-8d62-bfd181b7a643 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:01.543587 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8c8e48de-18bf-402f-8d62-bfd181b7a643 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.201779 Jun 16 15:00:01.544170 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 330/660] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:00:01 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:00:01.634989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-74097c21-60df-4224-a080-dcdb33e0d882 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:01.635707 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-74097c21-60df-4224-a080-dcdb33e0d882 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:01.642427 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-74097c21-60df-4224-a080-dcdb33e0d882 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:01.642905 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-74097c21-60df-4224-a080-dcdb33e0d882 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:01.643672 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-74097c21-60df-4224-a080-dcdb33e0d882 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:01.644129 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-74097c21-60df-4224-a080-dcdb33e0d882 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:01.788852 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-74097c21-60df-4224-a080-dcdb33e0d882 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:01.796434 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-74097c21-60df-4224-a080-dcdb33e0d882 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1271 microversion: 2.1 time: 0.166247 Jun 16 15:00:01.796996 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 331/661] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:01 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:02.147674 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1375b550-d81c-4860-81fa-6ccfd891da37 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:02.148293 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-1375b550-d81c-4860-81fa-6ccfd891da37 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:02.150094 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=2 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:02.155518 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1375b550-d81c-4860-81fa-6ccfd891da37 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:02.155983 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1375b550-d81c-4860-81fa-6ccfd891da37 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:02.156735 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1375b550-d81c-4860-81fa-6ccfd891da37 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:02.157415 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1375b550-d81c-4860-81fa-6ccfd891da37 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:02.277053 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d3c6ce1e-e123-4107-b00f-ba982cd78fce tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:02.277539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d3c6ce1e-e123-4107-b00f-ba982cd78fce tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:02.284246 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d3c6ce1e-e123-4107-b00f-ba982cd78fce tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:02.284765 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d3c6ce1e-e123-4107-b00f-ba982cd78fce tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:02.285545 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d3c6ce1e-e123-4107-b00f-ba982cd78fce tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:02.285982 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d3c6ce1e-e123-4107-b00f-ba982cd78fce tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:02.292020 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1375b550-d81c-4860-81fa-6ccfd891da37 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:02.300431 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1375b550-d81c-4860-81fa-6ccfd891da37 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1681 microversion: 2.1 time: 0.156546 Jun 16 15:00:02.301100 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 331/662] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:02 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:02.425378 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-d3c6ce1e-e123-4107-b00f-ba982cd78fce tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lazy-loading 'services' on Instance uuid 14563c3c-bdd4-46f1-890f-bf0aa3045d69 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:00:02.554751 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d3c6ce1e-e123-4107-b00f-ba982cd78fce tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "DELETE /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69/os-volume_attachments/11efa797-2982-4896-831c-1e9b0c1cdd19" status: 202 len: 0 microversion: 2.1 time: 0.281244 Jun 16 15:00:02.555640 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 332/663] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Jun 16 15:00:02 2022] DELETE /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69/os-volume_attachments/11efa797-2982-4896-831c-1e9b0c1cdd19 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 15:00:02.563277 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4002ef05-66f5-46f8-87d1-ab7aaf99a7b5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:02.563913 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4002ef05-66f5-46f8-87d1-ab7aaf99a7b5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:02.570048 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4002ef05-66f5-46f8-87d1-ab7aaf99a7b5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:02.570493 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4002ef05-66f5-46f8-87d1-ab7aaf99a7b5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:02.571265 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4002ef05-66f5-46f8-87d1-ab7aaf99a7b5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:02.571708 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4002ef05-66f5-46f8-87d1-ab7aaf99a7b5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:02.714050 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4002ef05-66f5-46f8-87d1-ab7aaf99a7b5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:02.723861 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4002ef05-66f5-46f8-87d1-ab7aaf99a7b5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:02.725407 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4002ef05-66f5-46f8-87d1-ab7aaf99a7b5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:02.730291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4002ef05-66f5-46f8-87d1-ab7aaf99a7b5 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.170071 Jun 16 15:00:02.731429 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 332/664] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:00:02 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:00:02.814301 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9f664c63-48a8-4708-92f4-99f006e555ae tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:02.814989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9f664c63-48a8-4708-92f4-99f006e555ae tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:02.821425 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9f664c63-48a8-4708-92f4-99f006e555ae tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:02.821868 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9f664c63-48a8-4708-92f4-99f006e555ae tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:02.822637 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9f664c63-48a8-4708-92f4-99f006e555ae tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:02.823072 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9f664c63-48a8-4708-92f4-99f006e555ae tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:03.043881 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9f664c63-48a8-4708-92f4-99f006e555ae tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:03.051452 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9f664c63-48a8-4708-92f4-99f006e555ae tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.241833 Jun 16 15:00:03.052060 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 333/665] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:02 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:03.076521 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-e4ba89db-bd63-45c1-a999-195857b6bca2 req-a46dc52e-249a-4614-81ea-3ab6086f8adf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663488be-459f-4a58-aa1c-82be04813a2f", "name": "network-vif-plugged", "status": "completed", "tag": "5508bdf2-993b-44f0-8926-4159b1e31b1d"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:03.084885 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-e4ba89db-bd63-45c1-a999-195857b6bca2 req-a46dc52e-249a-4614-81ea-3ab6086f8adf service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:03.085318 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-e4ba89db-bd63-45c1-a999-195857b6bca2 req-a46dc52e-249a-4614-81ea-3ab6086f8adf service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:03.097563 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-e4ba89db-bd63-45c1-a999-195857b6bca2 req-a46dc52e-249a-4614-81ea-3ab6086f8adf service nova] Creating event network-vif-plugged:5508bdf2-993b-44f0-8926-4159b1e31b1d for instance 663488be-459f-4a58-aa1c-82be04813a2f on hv-cinder-83716 Jun 16 15:00:03.102537 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-e4ba89db-bd63-45c1-a999-195857b6bca2 req-a46dc52e-249a-4614-81ea-3ab6086f8adf service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030061 Jun 16 15:00:03.103127 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 333/666] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:03.320143 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-dcd2e692-96b4-4d55-9859-3d41a41ec9dc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:03.320751 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-dcd2e692-96b4-4d55-9859-3d41a41ec9dc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:03.327399 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dcd2e692-96b4-4d55-9859-3d41a41ec9dc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:03.327889 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dcd2e692-96b4-4d55-9859-3d41a41ec9dc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:03.328650 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dcd2e692-96b4-4d55-9859-3d41a41ec9dc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:03.329089 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dcd2e692-96b4-4d55-9859-3d41a41ec9dc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:03.529448 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-dcd2e692-96b4-4d55-9859-3d41a41ec9dc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:03.539007 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-dcd2e692-96b4-4d55-9859-3d41a41ec9dc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1681 microversion: 2.1 time: 0.222926 Jun 16 15:00:03.539981 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 334/667] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:03 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1681 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:03.749947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6ba12df0-8b6e-4845-a13c-2ebbec90bf4e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:03.750523 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6ba12df0-8b6e-4845-a13c-2ebbec90bf4e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:03.756900 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6ba12df0-8b6e-4845-a13c-2ebbec90bf4e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:03.757341 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6ba12df0-8b6e-4845-a13c-2ebbec90bf4e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:03.758090 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6ba12df0-8b6e-4845-a13c-2ebbec90bf4e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:03.758517 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6ba12df0-8b6e-4845-a13c-2ebbec90bf4e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:03.898559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6ba12df0-8b6e-4845-a13c-2ebbec90bf4e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:03.909252 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6ba12df0-8b6e-4845-a13c-2ebbec90bf4e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:03.911489 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6ba12df0-8b6e-4845-a13c-2ebbec90bf4e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:03.912727 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6ba12df0-8b6e-4845-a13c-2ebbec90bf4e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.167187 Jun 16 15:00:03.924523 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 334/668] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:00:03 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:00:04.071031 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b6490a4a-e0c3-4758-ac52-018112f369a5 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:04.071654 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b6490a4a-e0c3-4758-ac52-018112f369a5 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:04.079448 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b6490a4a-e0c3-4758-ac52-018112f369a5 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:04.080620 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b6490a4a-e0c3-4758-ac52-018112f369a5 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:04.081560 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b6490a4a-e0c3-4758-ac52-018112f369a5 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:04.082102 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b6490a4a-e0c3-4758-ac52-018112f369a5 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:04.364376 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b6490a4a-e0c3-4758-ac52-018112f369a5 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:04.374597 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b6490a4a-e0c3-4758-ac52-018112f369a5 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.308976 Jun 16 15:00:04.375323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 335/669] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:04 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:04.557337 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-9b5f48a9-353c-41db-a2b1-dcdf33d61336 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:04.557932 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-9b5f48a9-353c-41db-a2b1-dcdf33d61336 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:04.564035 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9b5f48a9-353c-41db-a2b1-dcdf33d61336 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:04.564478 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9b5f48a9-353c-41db-a2b1-dcdf33d61336 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:04.565251 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9b5f48a9-353c-41db-a2b1-dcdf33d61336 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:04.565670 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9b5f48a9-353c-41db-a2b1-dcdf33d61336 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:04.629378 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-9b5f48a9-353c-41db-a2b1-dcdf33d61336 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:04.637639 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-9b5f48a9-353c-41db-a2b1-dcdf33d61336 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1614 microversion: 2.1 time: 0.083603 Jun 16 15:00:04.638328 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 335/670] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:04 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:04.742653 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-1cb6e6fd-9592-4bd0-9ff3-341a02581184 req-41f7d5dc-d12f-43e1-8e4a-7276d1cea49f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb2c36e-f3e4-44bf-bec8-b512d6b0c970", "name": "network-vif-deleted", "tag": "f4ee3cc3-a516-4b35-8827-b0d6dbf7a1a8"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:04.756761 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a7752f3b-531e-44f3-9f3a-823062feddf4 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:04.757391 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a7752f3b-531e-44f3-9f3a-823062feddf4 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:04.770216 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-1cb6e6fd-9592-4bd0-9ff3-341a02581184 req-41f7d5dc-d12f-43e1-8e4a-7276d1cea49f service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:04.776573 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-1cb6e6fd-9592-4bd0-9ff3-341a02581184 req-41f7d5dc-d12f-43e1-8e4a-7276d1cea49f service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:04.778413 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a7752f3b-531e-44f3-9f3a-823062feddf4 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:04.778946 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a7752f3b-531e-44f3-9f3a-823062feddf4 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:04.779773 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a7752f3b-531e-44f3-9f3a-823062feddf4 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:04.780203 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a7752f3b-531e-44f3-9f3a-823062feddf4 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:04.789858 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-1cb6e6fd-9592-4bd0-9ff3-341a02581184 req-41f7d5dc-d12f-43e1-8e4a-7276d1cea49f service nova] Creating event network-vif-deleted:f4ee3cc3-a516-4b35-8827-b0d6dbf7a1a8 for instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 on hv-cinder-83716 Jun 16 15:00:04.800437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-1cb6e6fd-9592-4bd0-9ff3-341a02581184 req-41f7d5dc-d12f-43e1-8e4a-7276d1cea49f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060085 Jun 16 15:00:04.804745 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 336/671] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:04.833019 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a7752f3b-531e-44f3-9f3a-823062feddf4 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Going to try to terminate instance {{(pid=117443) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:00:04.916252 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a7752f3b-531e-44f3-9f3a-823062feddf4 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "DELETE /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 204 len: 0 microversion: 2.1 time: 0.164222 Jun 16 15:00:04.916924 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 336/672] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:00:04 2022] DELETE /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:00:04.926713 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a747ee95-5c87-4db6-921d-a553a29023c1 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:04.927527 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a747ee95-5c87-4db6-921d-a553a29023c1 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:04.936879 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-aed13a3e-1b39-4ba6-b1eb-e2a2dc864f7d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:04.937879 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-aed13a3e-1b39-4ba6-b1eb-e2a2dc864f7d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:04.940141 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a747ee95-5c87-4db6-921d-a553a29023c1 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:04.941461 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a747ee95-5c87-4db6-921d-a553a29023c1 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:04.942461 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a747ee95-5c87-4db6-921d-a553a29023c1 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:04.943460 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a747ee95-5c87-4db6-921d-a553a29023c1 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:04.944916 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aed13a3e-1b39-4ba6-b1eb-e2a2dc864f7d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:04.945428 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aed13a3e-1b39-4ba6-b1eb-e2a2dc864f7d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:04.946259 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aed13a3e-1b39-4ba6-b1eb-e2a2dc864f7d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:04.946948 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aed13a3e-1b39-4ba6-b1eb-e2a2dc864f7d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:05.162975 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-aed13a3e-1b39-4ba6-b1eb-e2a2dc864f7d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:05.167052 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a747ee95-5c87-4db6-921d-a553a29023c1 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:05.173674 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-aed13a3e-1b39-4ba6-b1eb-e2a2dc864f7d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:05.175036 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a747ee95-5c87-4db6-921d-a553a29023c1 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1513 microversion: 2.1 time: 0.252859 Jun 16 15:00:05.175416 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-aed13a3e-1b39-4ba6-b1eb-e2a2dc864f7d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:05.175933 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 337/673] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:04 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1513 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:05.176816 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-aed13a3e-1b39-4ba6-b1eb-e2a2dc864f7d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.245170 Jun 16 15:00:05.177580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 337/674] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:00:04 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:00:05.396753 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a08748f3-f81e-4db7-880d-22276c0e3d7a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:05.397360 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a08748f3-f81e-4db7-880d-22276c0e3d7a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:05.404094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a08748f3-f81e-4db7-880d-22276c0e3d7a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:05.404538 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a08748f3-f81e-4db7-880d-22276c0e3d7a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:05.405304 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a08748f3-f81e-4db7-880d-22276c0e3d7a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:05.405734 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a08748f3-f81e-4db7-880d-22276c0e3d7a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:05.542563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a08748f3-f81e-4db7-880d-22276c0e3d7a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:05.550392 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a08748f3-f81e-4db7-880d-22276c0e3d7a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.157608 Jun 16 15:00:05.551043 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 338/675] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:05 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:05.654666 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-feaf136f-1bfd-4d9d-a35b-4ed25ede5a21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:05.655271 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-feaf136f-1bfd-4d9d-a35b-4ed25ede5a21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:05.662534 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-feaf136f-1bfd-4d9d-a35b-4ed25ede5a21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:05.663225 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-feaf136f-1bfd-4d9d-a35b-4ed25ede5a21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:05.664029 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-feaf136f-1bfd-4d9d-a35b-4ed25ede5a21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:05.664460 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-feaf136f-1bfd-4d9d-a35b-4ed25ede5a21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:05.696890 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-feaf136f-1bfd-4d9d-a35b-4ed25ede5a21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:05.697343 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-feaf136f-1bfd-4d9d-a35b-4ed25ede5a21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:05.697790 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.objects.instance [None req-feaf136f-1bfd-4d9d-a35b-4ed25ede5a21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lazy-loading 'fault' on Instance uuid fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 {{(pid=117443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:00:05.739406 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-feaf136f-1bfd-4d9d-a35b-4ed25ede5a21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:05.747580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-feaf136f-1bfd-4d9d-a35b-4ed25ede5a21 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1332 microversion: 2.1 time: 0.096715 Jun 16 15:00:05.748183 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 338/676] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:05 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:06.193059 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a152e841-f8c7-4794-96e8-77ad99d1e5b2 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:06.193904 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a152e841-f8c7-4794-96e8-77ad99d1e5b2 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:06.198946 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c96a4b5c-7ed2-4ca2-ac48-6a633dc4dde9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:06.200157 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c96a4b5c-7ed2-4ca2-ac48-6a633dc4dde9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:06.201600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a152e841-f8c7-4794-96e8-77ad99d1e5b2 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:06.202058 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a152e841-f8c7-4794-96e8-77ad99d1e5b2 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:06.203000 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a152e841-f8c7-4794-96e8-77ad99d1e5b2 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:06.203500 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a152e841-f8c7-4794-96e8-77ad99d1e5b2 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:06.206069 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c96a4b5c-7ed2-4ca2-ac48-6a633dc4dde9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:06.206521 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c96a4b5c-7ed2-4ca2-ac48-6a633dc4dde9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:06.207277 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c96a4b5c-7ed2-4ca2-ac48-6a633dc4dde9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:06.207733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c96a4b5c-7ed2-4ca2-ac48-6a633dc4dde9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:06.412086 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a152e841-f8c7-4794-96e8-77ad99d1e5b2 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:06.419493 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c96a4b5c-7ed2-4ca2-ac48-6a633dc4dde9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:06.420290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a152e841-f8c7-4794-96e8-77ad99d1e5b2 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1513 microversion: 2.1 time: 0.231366 Jun 16 15:00:06.420875 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 339/677] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:06 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:06.428228 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c96a4b5c-7ed2-4ca2-ac48-6a633dc4dde9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:06.429787 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c96a4b5c-7ed2-4ca2-ac48-6a633dc4dde9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:06.430998 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c96a4b5c-7ed2-4ca2-ac48-6a633dc4dde9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.236203 Jun 16 15:00:06.431539 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 339/678] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:00:06 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:00:06.568408 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-615fc8cb-c38b-42fc-bd1b-90d421eb4e26 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:06.568938 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-615fc8cb-c38b-42fc-bd1b-90d421eb4e26 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:06.575590 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-615fc8cb-c38b-42fc-bd1b-90d421eb4e26 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:06.576059 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-615fc8cb-c38b-42fc-bd1b-90d421eb4e26 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:06.576814 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-615fc8cb-c38b-42fc-bd1b-90d421eb4e26 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:06.577243 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-615fc8cb-c38b-42fc-bd1b-90d421eb4e26 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:06.718298 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-615fc8cb-c38b-42fc-bd1b-90d421eb4e26 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:06.726126 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-615fc8cb-c38b-42fc-bd1b-90d421eb4e26 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.161912 Jun 16 15:00:06.726837 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 340/679] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:06 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:06.764993 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-88487c39-09ce-42d5-855a-33e704e2cf28 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:06.765589 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-88487c39-09ce-42d5-855a-33e704e2cf28 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:06.771603 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-88487c39-09ce-42d5-855a-33e704e2cf28 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:06.772080 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-88487c39-09ce-42d5-855a-33e704e2cf28 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:06.772855 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-88487c39-09ce-42d5-855a-33e704e2cf28 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:06.773442 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-88487c39-09ce-42d5-855a-33e704e2cf28 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:06.805480 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-88487c39-09ce-42d5-855a-33e704e2cf28 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:06.805927 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-88487c39-09ce-42d5-855a-33e704e2cf28 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:06.806376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.objects.instance [None req-88487c39-09ce-42d5-855a-33e704e2cf28 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lazy-loading 'fault' on Instance uuid fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 {{(pid=117443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:00:06.847804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-88487c39-09ce-42d5-855a-33e704e2cf28 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:06.855312 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-88487c39-09ce-42d5-855a-33e704e2cf28 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1332 microversion: 2.1 time: 0.094230 Jun 16 15:00:06.856581 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 340/680] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:06 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:07.438084 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b719426e-a37b-41a2-96ab-082729fc7ca6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:07.438700 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b719426e-a37b-41a2-96ab-082729fc7ca6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:07.445688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b719426e-a37b-41a2-96ab-082729fc7ca6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:07.446219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b719426e-a37b-41a2-96ab-082729fc7ca6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:07.447070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b719426e-a37b-41a2-96ab-082729fc7ca6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:07.447592 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b719426e-a37b-41a2-96ab-082729fc7ca6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:07.449816 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7d9231e7-832d-4e0d-b2aa-e1b3ba59adaf tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:07.450435 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7d9231e7-832d-4e0d-b2aa-e1b3ba59adaf tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:07.458057 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7d9231e7-832d-4e0d-b2aa-e1b3ba59adaf tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:07.458502 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7d9231e7-832d-4e0d-b2aa-e1b3ba59adaf tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:07.459552 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7d9231e7-832d-4e0d-b2aa-e1b3ba59adaf tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:07.460041 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7d9231e7-832d-4e0d-b2aa-e1b3ba59adaf tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:07.649263 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b719426e-a37b-41a2-96ab-082729fc7ca6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:07.661811 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b719426e-a37b-41a2-96ab-082729fc7ca6 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1513 microversion: 2.1 time: 0.227505 Jun 16 15:00:07.664963 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7d9231e7-832d-4e0d-b2aa-e1b3ba59adaf tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:07.675535 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7d9231e7-832d-4e0d-b2aa-e1b3ba59adaf tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:07.677219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 341/681] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:07 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:07.677982 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7d9231e7-832d-4e0d-b2aa-e1b3ba59adaf tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:07.679575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7d9231e7-832d-4e0d-b2aa-e1b3ba59adaf tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.233724 Jun 16 15:00:07.680316 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 341/682] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:00:07 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:00:07.742948 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e96fbe96-a511-46b6-be2a-e76f830a008e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:07.743535 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e96fbe96-a511-46b6-be2a-e76f830a008e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:07.750033 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e96fbe96-a511-46b6-be2a-e76f830a008e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:07.750522 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e96fbe96-a511-46b6-be2a-e76f830a008e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:07.751248 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e96fbe96-a511-46b6-be2a-e76f830a008e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:07.751698 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e96fbe96-a511-46b6-be2a-e76f830a008e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:07.874075 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ac6fd66e-f0d7-4ef4-8384-fb1d62cd65a6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:07.874685 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ac6fd66e-f0d7-4ef4-8384-fb1d62cd65a6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:07.881707 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ac6fd66e-f0d7-4ef4-8384-fb1d62cd65a6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:07.882158 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ac6fd66e-f0d7-4ef4-8384-fb1d62cd65a6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:07.883080 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ac6fd66e-f0d7-4ef4-8384-fb1d62cd65a6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:07.883519 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ac6fd66e-f0d7-4ef4-8384-fb1d62cd65a6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:07.888461 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e96fbe96-a511-46b6-be2a-e76f830a008e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:07.896348 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e96fbe96-a511-46b6-be2a-e76f830a008e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.157146 Jun 16 15:00:07.897574 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 342/683] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:07 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:07.925974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ac6fd66e-f0d7-4ef4-8384-fb1d62cd65a6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:07.926423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ac6fd66e-f0d7-4ef4-8384-fb1d62cd65a6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:07.926869 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.objects.instance [None req-ac6fd66e-f0d7-4ef4-8384-fb1d62cd65a6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lazy-loading 'fault' on Instance uuid fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 {{(pid=117443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:00:07.971427 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ac6fd66e-f0d7-4ef4-8384-fb1d62cd65a6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:07.979011 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ac6fd66e-f0d7-4ef4-8384-fb1d62cd65a6 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 200 len: 1332 microversion: 2.1 time: 0.109395 Jun 16 15:00:07.979574 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 342/684] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:07 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:08.690995 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b90c7f9e-676a-4cc6-93ec-1c1988ef0e13 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:08.691873 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b90c7f9e-676a-4cc6-93ec-1c1988ef0e13 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:08.698322 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f568255b-1e1d-4630-9068-6367c9ecf118 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:08.698771 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b90c7f9e-676a-4cc6-93ec-1c1988ef0e13 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:08.698924 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f568255b-1e1d-4630-9068-6367c9ecf118 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:08.699027 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b90c7f9e-676a-4cc6-93ec-1c1988ef0e13 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:08.700411 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b90c7f9e-676a-4cc6-93ec-1c1988ef0e13 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:08.700845 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b90c7f9e-676a-4cc6-93ec-1c1988ef0e13 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:08.706075 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f568255b-1e1d-4630-9068-6367c9ecf118 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:08.706501 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f568255b-1e1d-4630-9068-6367c9ecf118 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:08.707262 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f568255b-1e1d-4630-9068-6367c9ecf118 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:08.707708 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f568255b-1e1d-4630-9068-6367c9ecf118 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:08.994407 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b90c7f9e-676a-4cc6-93ec-1c1988ef0e13 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:09.003052 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b90c7f9e-676a-4cc6-93ec-1c1988ef0e13 tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1513 microversion: 2.1 time: 0.315983 Jun 16 15:00:09.004293 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 343/685] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:08 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1513 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:09.009626 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0ba79890-635c-4563-b537-29053b15f3c4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:09.010250 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0ba79890-635c-4563-b537-29053b15f3c4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:09.015586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f568255b-1e1d-4630-9068-6367c9ecf118 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:09.020173 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0ba79890-635c-4563-b537-29053b15f3c4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:09.020737 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0ba79890-635c-4563-b537-29053b15f3c4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:09.021610 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0ba79890-635c-4563-b537-29053b15f3c4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:09.022253 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0ba79890-635c-4563-b537-29053b15f3c4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:09.024738 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f568255b-1e1d-4630-9068-6367c9ecf118 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:09.026229 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f568255b-1e1d-4630-9068-6367c9ecf118 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:09.027598 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f568255b-1e1d-4630-9068-6367c9ecf118 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1809 microversion: 2.20 time: 0.333468 Jun 16 15:00:09.028234 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 343/686] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:00:08 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1809 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:00:09.033142 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c909a51b-64f8-4a0c-a88a-4ce059ba271e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:09.034061 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c909a51b-64f8-4a0c-a88a-4ce059ba271e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:09.041647 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:09.052590 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c909a51b-64f8-4a0c-a88a-4ce059ba271e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:09.053158 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c909a51b-64f8-4a0c-a88a-4ce059ba271e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:09.053992 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c909a51b-64f8-4a0c-a88a-4ce059ba271e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:09.054425 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c909a51b-64f8-4a0c-a88a-4ce059ba271e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:09.069444 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-c909a51b-64f8-4a0c-a88a-4ce059ba271e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] HTTP exception thrown: Instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 could not be found. Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c909a51b-64f8-4a0c-a88a-4ce059ba271e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Request method failure captured: Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 HTTP/1.1 Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0RvgNnHERAvlrn1WvFUUcvodkCzzgEgc9uA3Ra8J3x-gaqNyXJgZlXW9Fu3DW2tOgMnX7C8vwaaaUd2R9Mf98qk7wOTE2lojDUYY_ofhKl3QsPjUp0j-B30CwpTfHwGiZa1GU9kj2dLQMYLnA0B8U66Nc60nNiPBn1l71iNpcPmPQ4 Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 15:00:09.071098 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 15:00:09.072693 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_60ade68614ac4730a35c9958123d06e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:00:09.072693 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:00:09.072693 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:00:09.072693 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:00:09.072693 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:00:09.072693 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 15:00:09.072693 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 15:00:09.072693 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: 87a6ec62b5414930bf36f69f072d7df6 Jun 16 15:00:09.072693 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:00:09.072693 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 15:00:09.072693 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 could not be found. Jun 16 15:00:09.072693 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': 'fdb2c36e-f3e4-44bf-bec8-b512d6b0c970'} Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 could not be found. Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:00:09.073492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:00:09.074888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:00:09.074888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:00:09.074888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:00:09.074888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:00:09.074888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:00:09.074888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:00:09.074888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:00:09.074888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 could not be found. Jun 16 15:00:09.074888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:00:09.074888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:00:09.074888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:00:09.074888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:00:09.074888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:00:09.074888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:00:09.074888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:00:09.074888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:00:09.074888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 could not be found. Jun 16 15:00:09.074888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:00:09.076214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c909a51b-64f8-4a0c-a88a-4ce059ba271e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Returning 404 to user: Instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:00:09.076214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c909a51b-64f8-4a0c-a88a-4ce059ba271e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 404 len: 111 microversion: 2.1 time: 0.043205 Jun 16 15:00:09.076214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 344/687] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:09 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:00:09.081414 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-698854cb-10bc-4f98-8799-c9c25d0d8939 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '.version_select at 0x7f33e3c27f70>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:09.099217 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-698854cb-10bc-4f98-8799-c9c25d0d8939 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1942964515" status: 202 len: 0 microversion: 2.1 time: 0.021514 Jun 16 15:00:09.099821 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 345/688] 10.222.0.76 () {58 vars in 1220 bytes} [Thu Jun 16 15:00:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1942964515 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 15:00:09.261830 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0ba79890-635c-4563-b537-29053b15f3c4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:09.270946 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0ba79890-635c-4563-b537-29053b15f3c4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.264596 Jun 16 15:00:09.281569 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 344/689] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:09 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:09.487456 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-fe056e64-2359-4de9-89ea-fe9dfae1bdb3 req-41a5cfbe-2766-447f-b13c-0076c9e8f3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14563c3c-bdd4-46f1-890f-bf0aa3045d69", "name": "network-vif-deleted", "tag": "7423e547-f966-4e2a-8d0c-a9f36a726ddf"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:09.496203 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-fe056e64-2359-4de9-89ea-fe9dfae1bdb3 req-41a5cfbe-2766-447f-b13c-0076c9e8f3c0 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:09.496906 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-fe056e64-2359-4de9-89ea-fe9dfae1bdb3 req-41a5cfbe-2766-447f-b13c-0076c9e8f3c0 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:09.511191 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-fe056e64-2359-4de9-89ea-fe9dfae1bdb3 req-41a5cfbe-2766-447f-b13c-0076c9e8f3c0 service nova] Creating event network-vif-deleted:7423e547-f966-4e2a-8d0c-a9f36a726ddf for instance 14563c3c-bdd4-46f1-890f-bf0aa3045d69 on hv-cinder-83716 Jun 16 15:00:09.517716 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-fe056e64-2359-4de9-89ea-fe9dfae1bdb3 req-41a5cfbe-2766-447f-b13c-0076c9e8f3c0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034638 Jun 16 15:00:09.518571 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 346/690] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:09.817516 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4eebed46-d1b1-424a-901e-b64665acef8a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Action: 'create', calling method: .version_select at 0x7f33e17ea430>, body: {"keypair": {"name": "tempest-keypair-176369710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMooD3rPoz6262oBjqzb0ndQWglLNIBC7qHplsNvs0V7814Sw1XMr4/9imxVKtzh6mpmU4Df1O9a8j0W65/7G8zo0jBra4BGy4U8ZYOkcDlnoHvIdHb9NKCGSCTJ9FmXgQ=="}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:09.832706 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-4eebed46-d1b1-424a-901e-b64665acef8a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Getting quotas for project 60ade68614ac4730a35c9958123d06e8. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:00:09.836560 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-4eebed46-d1b1-424a-901e-b64665acef8a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Getting quotas for user 87a6ec62b5414930bf36f69f072d7df6 and project 60ade68614ac4730a35c9958123d06e8. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:00:09.864662 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4eebed46-d1b1-424a-901e-b64665acef8a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051014 Jun 16 15:00:09.865332 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 345/691] 10.222.0.76 () {60 vars in 1158 bytes} [Thu Jun 16 15:00:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:10.022370 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-152b67e5-f119-4333-9507-620033b81f8a tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:10.029798 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-152b67e5-f119-4333-9507-620033b81f8a tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:10.040102 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-152b67e5-f119-4333-9507-620033b81f8a tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:10.040672 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-152b67e5-f119-4333-9507-620033b81f8a tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:10.041570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-152b67e5-f119-4333-9507-620033b81f8a tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:10.042118 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-152b67e5-f119-4333-9507-620033b81f8a tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:10.048319 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-080ec9ae-05cf-42d2-b072-3d4aa0afa254 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:10.049468 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-080ec9ae-05cf-42d2-b072-3d4aa0afa254 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:10.056886 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-080ec9ae-05cf-42d2-b072-3d4aa0afa254 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:10.057567 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-080ec9ae-05cf-42d2-b072-3d4aa0afa254 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:10.058501 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-080ec9ae-05cf-42d2-b072-3d4aa0afa254 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:10.059701 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-080ec9ae-05cf-42d2-b072-3d4aa0afa254 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:10.064121 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:10.082706 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-152b67e5-f119-4333-9507-620033b81f8a tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:10.083652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-152b67e5-f119-4333-9507-620033b81f8a tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:10.083652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.objects.instance [None req-152b67e5-f119-4333-9507-620033b81f8a tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lazy-loading 'fault' on Instance uuid 14563c3c-bdd4-46f1-890f-bf0aa3045d69 {{(pid=117443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:00:10.163088 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-152b67e5-f119-4333-9507-620033b81f8a tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c7f2af8fa4f68a80d006105a96ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef1f9d9b1a74f84a3cdda0feb12ad0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:10.172513 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-152b67e5-f119-4333-9507-620033b81f8a tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 200 len: 1309 microversion: 2.1 time: 0.155120 Jun 16 15:00:10.173277 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 347/692] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:10 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 1309 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:10.286924 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-080ec9ae-05cf-42d2-b072-3d4aa0afa254 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:10.294448 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b695caae-e0b1-4fac-9f07-b3452391f5f0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:10.295775 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b695caae-e0b1-4fac-9f07-b3452391f5f0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:10.306043 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-080ec9ae-05cf-42d2-b072-3d4aa0afa254 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:10.307303 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b695caae-e0b1-4fac-9f07-b3452391f5f0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:10.308189 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b695caae-e0b1-4fac-9f07-b3452391f5f0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:10.309823 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b695caae-e0b1-4fac-9f07-b3452391f5f0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:10.310408 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b695caae-e0b1-4fac-9f07-b3452391f5f0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:10.311007 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-080ec9ae-05cf-42d2-b072-3d4aa0afa254 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:10.312783 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-080ec9ae-05cf-42d2-b072-3d4aa0afa254 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1796 microversion: 2.20 time: 0.268954 Jun 16 15:00:10.314091 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 346/693] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:00:10 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1796 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:00:10.568669 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b695caae-e0b1-4fac-9f07-b3452391f5f0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:10.576324 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b695caae-e0b1-4fac-9f07-b3452391f5f0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.287405 Jun 16 15:00:10.576904 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 348/694] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:10 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:11.189518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-10ac80d8-2e6d-4423-9005-4b18c801398c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:11.190131 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-10ac80d8-2e6d-4423-9005-4b18c801398c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] [instance: 14563c3c-bdd4-46f1-890f-bf0aa3045d69] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:11.197648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10ac80d8-2e6d-4423-9005-4b18c801398c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:11.198150 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10ac80d8-2e6d-4423-9005-4b18c801398c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:11.198843 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10ac80d8-2e6d-4423-9005-4b18c801398c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:11.199791 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10ac80d8-2e6d-4423-9005-4b18c801398c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:11.213818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-10ac80d8-2e6d-4423-9005-4b18c801398c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] HTTP exception thrown: Instance 14563c3c-bdd4-46f1-890f-bf0aa3045d69 could not be found. Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-10ac80d8-2e6d-4423-9005-4b18c801398c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Request method failure captured: Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 HTTP/1.1 Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0THEFtKCz9ZvSmtcD6GGWN4gyMIUGda9iKdXUKlakFbCEQtefR6wMPfO1LGH84XK40wVd6CSiJn-bB85B7gYjCSm-lLzBnTKpWyWcigp_72uioxCFoxMzH_bh55NvxkCI8P1zw7MdQ-XqjZQm6hkdFxvgk8C5EG_fVMh3Z3SuK1SIw Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: cef1f9d9b1a74f84a3cdda0feb12ad0c Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-VolumesSnapshotTestJSON-642161874 Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:00:11.216113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:00:11.217844 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/cef1f9d9b1a74f84a3cdda0feb12ad0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cef1f9d9b1a74f84a3cdda0feb12ad0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_cef1f9d9b1a74f84a3cdda0feb12ad0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/cef1f9d9b1a74f84a3cdda0feb12ad0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:00:11.217844 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-VolumesSnapshotTestJSON-642161874 Jun 16 15:00:11.217844 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: cef1f9d9b1a74f84a3cdda0feb12ad0c Jun 16 15:00:11.217844 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-642161874 Jun 16 15:00:11.217844 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-VolumesSnapshotTestJSON-642161874-project Jun 16 15:00:11.217844 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:00:11.217844 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:00:11.217844 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 4b6c7f2af8fa4f68a80d006105a96ee3 Jun 16 15:00:11.217844 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-VolumesSnapshotTestJSON-642161874-project Jun 16 15:00:11.217844 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:00:11.217844 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance 14563c3c-bdd4-46f1-890f-bf0aa3045d69 could not be found. Jun 16 15:00:11.217844 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': '14563c3c-bdd4-46f1-890f-bf0aa3045d69'} Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14563c3c-bdd4-46f1-890f-bf0aa3045d69 could not be found. Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:00:11.219111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:00:11.220515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:00:11.220515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:00:11.220515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:00:11.220515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:00:11.220515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:00:11.220515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:00:11.220515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:00:11.220515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14563c3c-bdd4-46f1-890f-bf0aa3045d69 could not be found. Jun 16 15:00:11.220515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:00:11.220515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:00:11.220515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:00:11.220515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:00:11.220515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:00:11.220515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:00:11.220515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:00:11.220515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:00:11.220515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14563c3c-bdd4-46f1-890f-bf0aa3045d69 could not be found. Jun 16 15:00:11.220515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:00:11.221750 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-10ac80d8-2e6d-4423-9005-4b18c801398c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] Returning 404 to user: Instance 14563c3c-bdd4-46f1-890f-bf0aa3045d69 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:00:11.221750 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-10ac80d8-2e6d-4423-9005-4b18c801398c tempest-VolumesSnapshotTestJSON-642161874 tempest-VolumesSnapshotTestJSON-642161874-project] 10.222.0.76 "GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69" status: 404 len: 111 microversion: 2.1 time: 0.031855 Jun 16 15:00:11.221750 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 347/695] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:11 2022] GET /compute/v2.1/servers/14563c3c-bdd4-46f1-890f-bf0aa3045d69 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:00:11.328125 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3fd4452d-4964-481a-ab6e-02e1c019eb6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-243087690", "imageRef": "f2f37ffa-db20-478d-84c0-b429a987933c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3e2520f-526d-4c84-9c0f-99f9be8b2582"}], "security_groups": [{"name": "tempest-securitygroup--1387061599"}], "key_name": "tempest-keypair-176369710", "user_data": "}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:11.439272 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.network.neutron [None req-3fd4452d-4964-481a-ab6e-02e1c019eb6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] validate_networks() for [('f3e2520f-526d-4c84-9c0f-99f9be8b2582', None, None, None, None, None)] {{(pid=117443) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:00:11.595526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a4167681-8c2c-441f-ab38-b72f270e6b9d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:11.596247 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a4167681-8c2c-441f-ab38-b72f270e6b9d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:11.603833 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a4167681-8c2c-441f-ab38-b72f270e6b9d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:11.604441 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a4167681-8c2c-441f-ab38-b72f270e6b9d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:11.605838 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a4167681-8c2c-441f-ab38-b72f270e6b9d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:11.606575 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a4167681-8c2c-441f-ab38-b72f270e6b9d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:11.904953 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a4167681-8c2c-441f-ab38-b72f270e6b9d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:11.913044 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a4167681-8c2c-441f-ab38-b72f270e6b9d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.323267 Jun 16 15:00:11.913647 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 348/696] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:11 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:12.152096 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-3fd4452d-4964-481a-ab6e-02e1c019eb6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Flavor limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:00:12.153018 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-3fd4452d-4964-481a-ab6e-02e1c019eb6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Image limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:00:12.153493 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-3fd4452d-4964-481a-ab6e-02e1c019eb6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Flavor pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:00:12.153916 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-3fd4452d-4964-481a-ab6e-02e1c019eb6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Image pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:00:12.154320 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-3fd4452d-4964-481a-ab6e-02e1c019eb6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:00:12.163599 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3fd4452d-4964-481a-ab6e-02e1c019eb6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:12.164083 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3fd4452d-4964-481a-ab6e-02e1c019eb6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:12.172408 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3fd4452d-4964-481a-ab6e-02e1c019eb6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:12.172858 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3fd4452d-4964-481a-ab6e-02e1c019eb6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:12.191057 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-3fd4452d-4964-481a-ab6e-02e1c019eb6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Getting quotas for project 60ade68614ac4730a35c9958123d06e8. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:00:12.195207 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-3fd4452d-4964-481a-ab6e-02e1c019eb6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Getting quotas for user 87a6ec62b5414930bf36f69f072d7df6 and project 60ade68614ac4730a35c9958123d06e8. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:00:12.206168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-3fd4452d-4964-481a-ab6e-02e1c019eb6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Going to run 1 instances... {{(pid=117443) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:00:12.208548 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-3fd4452d-4964-481a-ab6e-02e1c019eb6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2f37ffa-db20-478d-84c0-b429a987933c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:00:12.256591 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3fd4452d-4964-481a-ab6e-02e1c019eb6b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.933338 Jun 16 15:00:12.257227 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 349/697] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 15:00:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 15:00:12.267117 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-36ee5da1-a586-4144-96d3-4d445f597e38 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:12.267750 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-36ee5da1-a586-4144-96d3-4d445f597e38 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:12.322857 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-36ee5da1-a586-4144-96d3-4d445f597e38 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:12.332608 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-36ee5da1-a586-4144-96d3-4d445f597e38 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1240 microversion: 2.1 time: 0.069292 Jun 16 15:00:12.333201 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 349/698] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:12 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:12.929569 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-19183c27-74fb-4e08-8a1c-91f44dc9e25a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:12.930096 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-19183c27-74fb-4e08-8a1c-91f44dc9e25a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:12.936868 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-19183c27-74fb-4e08-8a1c-91f44dc9e25a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:12.937315 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-19183c27-74fb-4e08-8a1c-91f44dc9e25a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:12.938080 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-19183c27-74fb-4e08-8a1c-91f44dc9e25a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:12.938518 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-19183c27-74fb-4e08-8a1c-91f44dc9e25a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:13.073166 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-19183c27-74fb-4e08-8a1c-91f44dc9e25a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:13.081170 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-19183c27-74fb-4e08-8a1c-91f44dc9e25a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.155556 Jun 16 15:00:13.081721 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 350/699] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:12 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:13.173745 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-95c38b1d-4502-4ddc-ac2f-2d8a3dbddb9e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:13.174749 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-95c38b1d-4502-4ddc-ac2f-2d8a3dbddb9e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:13.181921 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-95c38b1d-4502-4ddc-ac2f-2d8a3dbddb9e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:13.182306 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-95c38b1d-4502-4ddc-ac2f-2d8a3dbddb9e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:13.183163 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-95c38b1d-4502-4ddc-ac2f-2d8a3dbddb9e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:13.184113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-95c38b1d-4502-4ddc-ac2f-2d8a3dbddb9e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:13.271594 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-95c38b1d-4502-4ddc-ac2f-2d8a3dbddb9e tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "POST /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/action" status: 202 len: 0 microversion: 2.1 time: 0.101575 Jun 16 15:00:13.272319 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 350/700] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Jun 16 15:00:13 2022] POST /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:00:13.280399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6ff6d569-8f1d-43bf-8756-4b857c5c37b7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:13.281033 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6ff6d569-8f1d-43bf-8756-4b857c5c37b7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:13.287458 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6ff6d569-8f1d-43bf-8756-4b857c5c37b7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:13.287946 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6ff6d569-8f1d-43bf-8756-4b857c5c37b7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:13.288704 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6ff6d569-8f1d-43bf-8756-4b857c5c37b7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:13.289134 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6ff6d569-8f1d-43bf-8756-4b857c5c37b7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:13.352038 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8b8c7c71-2b02-4408-9cf0-f0dfba6facd3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:13.352743 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8b8c7c71-2b02-4408-9cf0-f0dfba6facd3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:13.359954 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8b8c7c71-2b02-4408-9cf0-f0dfba6facd3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:13.360414 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8b8c7c71-2b02-4408-9cf0-f0dfba6facd3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:13.361219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8b8c7c71-2b02-4408-9cf0-f0dfba6facd3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:13.361631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8b8c7c71-2b02-4408-9cf0-f0dfba6facd3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:13.440144 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8b8c7c71-2b02-4408-9cf0-f0dfba6facd3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:13.447826 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8b8c7c71-2b02-4408-9cf0-f0dfba6facd3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1292 microversion: 2.1 time: 0.100571 Jun 16 15:00:13.448400 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 351/701] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:13 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1292 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:13.457852 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6ff6d569-8f1d-43bf-8756-4b857c5c37b7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:13.465769 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6ff6d569-8f1d-43bf-8756-4b857c5c37b7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1750 microversion: 2.1 time: 0.189168 Jun 16 15:00:13.466319 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 351/702] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:13 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1750 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:14.097875 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d5425362-3799-4f79-bfff-b1a49394f314 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:14.098402 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d5425362-3799-4f79-bfff-b1a49394f314 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:14.104428 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d5425362-3799-4f79-bfff-b1a49394f314 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:14.104881 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d5425362-3799-4f79-bfff-b1a49394f314 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:14.105650 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d5425362-3799-4f79-bfff-b1a49394f314 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:14.106085 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d5425362-3799-4f79-bfff-b1a49394f314 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:14.239267 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d5425362-3799-4f79-bfff-b1a49394f314 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:14.246760 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d5425362-3799-4f79-bfff-b1a49394f314 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.152843 Jun 16 15:00:14.247313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 352/703] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:14 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:14.465651 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-32ab519f-f4be-40ec-8096-60eaee828633 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:14.466257 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-32ab519f-f4be-40ec-8096-60eaee828633 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:14.472488 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-32ab519f-f4be-40ec-8096-60eaee828633 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:14.472932 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-32ab519f-f4be-40ec-8096-60eaee828633 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:14.473720 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-32ab519f-f4be-40ec-8096-60eaee828633 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:14.474148 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-32ab519f-f4be-40ec-8096-60eaee828633 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:14.484536 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-196e033c-20d9-4ef8-89e9-f3dfe4958c89 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:14.485143 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-196e033c-20d9-4ef8-89e9-f3dfe4958c89 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:14.492116 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-196e033c-20d9-4ef8-89e9-f3dfe4958c89 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:14.492618 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-196e033c-20d9-4ef8-89e9-f3dfe4958c89 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:14.493424 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-196e033c-20d9-4ef8-89e9-f3dfe4958c89 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:14.493888 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-196e033c-20d9-4ef8-89e9-f3dfe4958c89 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:14.544822 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-32ab519f-f4be-40ec-8096-60eaee828633 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:14.552590 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-32ab519f-f4be-40ec-8096-60eaee828633 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1292 microversion: 2.1 time: 0.090750 Jun 16 15:00:14.553172 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 352/704] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:14 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1292 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:14.649012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-196e033c-20d9-4ef8-89e9-f3dfe4958c89 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:14.657681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-196e033c-20d9-4ef8-89e9-f3dfe4958c89 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1750 microversion: 2.1 time: 0.177015 Jun 16 15:00:14.658240 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 353/705] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:14 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:15.263273 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-91f8afeb-122d-4836-9076-1011a700b060 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:15.263909 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-91f8afeb-122d-4836-9076-1011a700b060 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:15.270017 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-91f8afeb-122d-4836-9076-1011a700b060 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:15.270458 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-91f8afeb-122d-4836-9076-1011a700b060 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:15.271214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-91f8afeb-122d-4836-9076-1011a700b060 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:15.271640 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-91f8afeb-122d-4836-9076-1011a700b060 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:15.412035 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-91f8afeb-122d-4836-9076-1011a700b060 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:15.420076 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-91f8afeb-122d-4836-9076-1011a700b060 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.160681 Jun 16 15:00:15.420637 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 353/706] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:15 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:15.570928 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-de0b467c-867d-4d94-9e6b-56729063c63e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:15.571470 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-de0b467c-867d-4d94-9e6b-56729063c63e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:15.579226 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-de0b467c-867d-4d94-9e6b-56729063c63e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:15.579673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-de0b467c-867d-4d94-9e6b-56729063c63e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:15.580466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-de0b467c-867d-4d94-9e6b-56729063c63e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:15.580900 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-de0b467c-867d-4d94-9e6b-56729063c63e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:15.641631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-de0b467c-867d-4d94-9e6b-56729063c63e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:15.649165 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-de0b467c-867d-4d94-9e6b-56729063c63e tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1292 microversion: 2.1 time: 0.082525 Jun 16 15:00:15.649729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 354/707] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:15 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:15.674181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-5d4c90e9-8b37-4ab1-9979-3dc37fb58646 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:15.674797 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-5d4c90e9-8b37-4ab1-9979-3dc37fb58646 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:15.681056 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5d4c90e9-8b37-4ab1-9979-3dc37fb58646 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:15.681498 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5d4c90e9-8b37-4ab1-9979-3dc37fb58646 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:15.682246 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5d4c90e9-8b37-4ab1-9979-3dc37fb58646 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:15.682665 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5d4c90e9-8b37-4ab1-9979-3dc37fb58646 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:15.847893 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-5d4c90e9-8b37-4ab1-9979-3dc37fb58646 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:15.856681 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-5d4c90e9-8b37-4ab1-9979-3dc37fb58646 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1750 microversion: 2.1 time: 0.186072 Jun 16 15:00:15.857464 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 354/708] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:15 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1750 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:16.438026 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-99debed0-1adc-4ffc-a2c2-b141ece3ef5f tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:16.438637 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-99debed0-1adc-4ffc-a2c2-b141ece3ef5f tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:16.444711 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-99debed0-1adc-4ffc-a2c2-b141ece3ef5f tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:16.445152 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-99debed0-1adc-4ffc-a2c2-b141ece3ef5f tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:16.445912 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-99debed0-1adc-4ffc-a2c2-b141ece3ef5f tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:16.446346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-99debed0-1adc-4ffc-a2c2-b141ece3ef5f tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:16.577862 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-99debed0-1adc-4ffc-a2c2-b141ece3ef5f tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:16.585350 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-99debed0-1adc-4ffc-a2c2-b141ece3ef5f tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.151177 Jun 16 15:00:16.585927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 355/709] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:16 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:16.667576 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e1d12f5c-e446-4cb7-ba49-708642eaed7d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:16.668245 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e1d12f5c-e446-4cb7-ba49-708642eaed7d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:16.674654 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e1d12f5c-e446-4cb7-ba49-708642eaed7d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:16.675248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e1d12f5c-e446-4cb7-ba49-708642eaed7d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:16.675943 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e1d12f5c-e446-4cb7-ba49-708642eaed7d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:16.676307 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e1d12f5c-e446-4cb7-ba49-708642eaed7d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:16.767943 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e1d12f5c-e446-4cb7-ba49-708642eaed7d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:16.778132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e1d12f5c-e446-4cb7-ba49-708642eaed7d tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1300 microversion: 2.1 time: 0.114959 Jun 16 15:00:16.778798 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 355/710] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:16 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1300 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:16.874425 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-eb310528-c50d-415c-acd2-9ac4242a9fbd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:16.875036 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-eb310528-c50d-415c-acd2-9ac4242a9fbd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:16.884878 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-eb310528-c50d-415c-acd2-9ac4242a9fbd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:16.885518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-eb310528-c50d-415c-acd2-9ac4242a9fbd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:16.886307 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-eb310528-c50d-415c-acd2-9ac4242a9fbd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:16.886813 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-eb310528-c50d-415c-acd2-9ac4242a9fbd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:17.120033 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-eb310528-c50d-415c-acd2-9ac4242a9fbd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:17.130779 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-eb310528-c50d-415c-acd2-9ac4242a9fbd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1750 microversion: 2.1 time: 0.260635 Jun 16 15:00:17.131665 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 356/711] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:16 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1750 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:17.452710 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-dae04a9e-808d-40a1-8525-53295600080d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21283df4-965b-4d19-81f0-82c4f8df7c3e"}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:17.453836 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-dae04a9e-808d-40a1-8525-53295600080d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:17.460379 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dae04a9e-808d-40a1-8525-53295600080d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:17.460839 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dae04a9e-808d-40a1-8525-53295600080d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:17.461596 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dae04a9e-808d-40a1-8525-53295600080d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:17.462027 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dae04a9e-808d-40a1-8525-53295600080d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:17.602323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e04fbcec-542b-49f8-9659-d2090969cb77 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:17.602934 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e04fbcec-542b-49f8-9659-d2090969cb77 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:17.609675 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e04fbcec-542b-49f8-9659-d2090969cb77 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:17.610126 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e04fbcec-542b-49f8-9659-d2090969cb77 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:17.610897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e04fbcec-542b-49f8-9659-d2090969cb77 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:17.611333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e04fbcec-542b-49f8-9659-d2090969cb77 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:17.789194 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e04fbcec-542b-49f8-9659-d2090969cb77 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:17.799221 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e04fbcec-542b-49f8-9659-d2090969cb77 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.199888 Jun 16 15:00:17.801658 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 357/712] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:17 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:17.806903 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-879948b3-64be-4516-a80c-31bbd7e8ad66 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:17.807793 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-879948b3-64be-4516-a80c-31bbd7e8ad66 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:17.821489 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-879948b3-64be-4516-a80c-31bbd7e8ad66 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:17.822857 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-879948b3-64be-4516-a80c-31bbd7e8ad66 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:17.824857 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-879948b3-64be-4516-a80c-31bbd7e8ad66 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:17.825983 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-879948b3-64be-4516-a80c-31bbd7e8ad66 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:17.879170 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-dae04a9e-808d-40a1-8525-53295600080d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "POST /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431663 Jun 16 15:00:17.879957 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 356/713] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Jun 16 15:00:17 2022] POST /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:18.088505 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-879948b3-64be-4516-a80c-31bbd7e8ad66 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:18.098421 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-879948b3-64be-4516-a80c-31bbd7e8ad66 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1366 microversion: 2.1 time: 0.295477 Jun 16 15:00:18.099121 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 358/714] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:17 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:18.150791 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-0d324873-873a-47d4-9a24-a8c519782193 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:18.151668 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-0d324873-873a-47d4-9a24-a8c519782193 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:18.158878 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0d324873-873a-47d4-9a24-a8c519782193 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:18.159920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0d324873-873a-47d4-9a24-a8c519782193 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:18.160429 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0d324873-873a-47d4-9a24-a8c519782193 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:18.161011 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0d324873-873a-47d4-9a24-a8c519782193 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:18.412028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-0d324873-873a-47d4-9a24-a8c519782193 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:18.424097 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-0d324873-873a-47d4-9a24-a8c519782193 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1755 microversion: 2.1 time: 0.275445 Jun 16 15:00:18.436586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 357/715] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:18 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1755 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:18.664906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-753b5188-c171-4525-9ba1-fc58ab837b3c req-f6bcbde9-f718-4dd5-8897-b73bf9017fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4d7f1ee-c351-40d2-8751-bbb43c7e4a57", "tag": "f79eb32a-fc6a-4e9d-b58c-8d301cf85cf9"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:18.678620 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-753b5188-c171-4525-9ba1-fc58ab837b3c req-f6bcbde9-f718-4dd5-8897-b73bf9017fc8 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:18.679179 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-753b5188-c171-4525-9ba1-fc58ab837b3c req-f6bcbde9-f718-4dd5-8897-b73bf9017fc8 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:18.696710 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-753b5188-c171-4525-9ba1-fc58ab837b3c req-f6bcbde9-f718-4dd5-8897-b73bf9017fc8 service nova] Creating event network-changed:f79eb32a-fc6a-4e9d-b58c-8d301cf85cf9 for instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 on hv-cinder-83716 Jun 16 15:00:18.713455 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-753b5188-c171-4525-9ba1-fc58ab837b3c req-f6bcbde9-f718-4dd5-8897-b73bf9017fc8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041132 Jun 16 15:00:18.714715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 359/716] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:18.818510 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-acee2f7f-5814-43aa-9640-1873c7617ac1 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:18.819080 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-acee2f7f-5814-43aa-9640-1873c7617ac1 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:18.821131 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:18.826842 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-acee2f7f-5814-43aa-9640-1873c7617ac1 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:18.827287 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-acee2f7f-5814-43aa-9640-1873c7617ac1 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:18.828079 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-acee2f7f-5814-43aa-9640-1873c7617ac1 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:18.828738 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-acee2f7f-5814-43aa-9640-1873c7617ac1 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:19.062946 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-acee2f7f-5814-43aa-9640-1873c7617ac1 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:19.071865 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-acee2f7f-5814-43aa-9640-1873c7617ac1 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.257666 Jun 16 15:00:19.072465 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 358/717] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:18 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:19.119243 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d538231d-766b-4027-8327-32be0b935835 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:19.120248 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d538231d-766b-4027-8327-32be0b935835 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:19.127089 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d538231d-766b-4027-8327-32be0b935835 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:19.127831 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d538231d-766b-4027-8327-32be0b935835 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:19.128824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d538231d-766b-4027-8327-32be0b935835 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:19.129265 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d538231d-766b-4027-8327-32be0b935835 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:19.342599 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d538231d-766b-4027-8327-32be0b935835 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:19.351358 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d538231d-766b-4027-8327-32be0b935835 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1366 microversion: 2.1 time: 0.236437 Jun 16 15:00:19.352058 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 360/718] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:19 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:19.443508 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1c495fe0-ad98-4d39-b9e2-e594828f4a8d tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:19.444122 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-1c495fe0-ad98-4d39-b9e2-e594828f4a8d tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:19.450976 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1c495fe0-ad98-4d39-b9e2-e594828f4a8d tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:19.451413 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1c495fe0-ad98-4d39-b9e2-e594828f4a8d tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:19.452194 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1c495fe0-ad98-4d39-b9e2-e594828f4a8d tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:19.452620 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1c495fe0-ad98-4d39-b9e2-e594828f4a8d tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:19.605717 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1c495fe0-ad98-4d39-b9e2-e594828f4a8d tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:19.615340 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1c495fe0-ad98-4d39-b9e2-e594828f4a8d tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1755 microversion: 2.1 time: 0.175014 Jun 16 15:00:19.616225 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 359/719] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:19 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:20.087947 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b949b2a6-3cd9-4aa0-9f6d-a53a8d04e5b6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:20.088554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b949b2a6-3cd9-4aa0-9f6d-a53a8d04e5b6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:20.094618 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b949b2a6-3cd9-4aa0-9f6d-a53a8d04e5b6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:20.095070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b949b2a6-3cd9-4aa0-9f6d-a53a8d04e5b6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:20.095877 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b949b2a6-3cd9-4aa0-9f6d-a53a8d04e5b6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:20.096352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b949b2a6-3cd9-4aa0-9f6d-a53a8d04e5b6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:20.230228 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b949b2a6-3cd9-4aa0-9f6d-a53a8d04e5b6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:20.238420 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b949b2a6-3cd9-4aa0-9f6d-a53a8d04e5b6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.154301 Jun 16 15:00:20.238987 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 361/720] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:20 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:20.368465 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3048d1d6-1aab-4628-94ef-94edfc132cb3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:20.369055 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-3048d1d6-1aab-4628-94ef-94edfc132cb3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:20.376193 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3048d1d6-1aab-4628-94ef-94edfc132cb3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:20.377651 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3048d1d6-1aab-4628-94ef-94edfc132cb3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:20.378427 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3048d1d6-1aab-4628-94ef-94edfc132cb3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:20.378859 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3048d1d6-1aab-4628-94ef-94edfc132cb3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:20.513731 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3048d1d6-1aab-4628-94ef-94edfc132cb3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:20.523291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3048d1d6-1aab-4628-94ef-94edfc132cb3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1366 microversion: 2.1 time: 0.158620 Jun 16 15:00:20.524037 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 360/721] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:20 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:20.632660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e04fd521-c5d9-4693-b416-3712a4270dce tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:20.633179 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e04fd521-c5d9-4693-b416-3712a4270dce tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:20.639127 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e04fd521-c5d9-4693-b416-3712a4270dce tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:20.639582 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e04fd521-c5d9-4693-b416-3712a4270dce tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:20.640401 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e04fd521-c5d9-4693-b416-3712a4270dce tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:20.640842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e04fd521-c5d9-4693-b416-3712a4270dce tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:20.872830 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e04fd521-c5d9-4693-b416-3712a4270dce tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:20.883341 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e04fd521-c5d9-4693-b416-3712a4270dce tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1755 microversion: 2.1 time: 0.254753 Jun 16 15:00:20.884069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 362/722] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:20 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1755 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:21.195510 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-1dfa529a-8abb-4393-8d46-7961311f9975 req-36f164d4-9a47-41c2-97ef-a187b069ff1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c", "name": "network-vif-plugged", "status": "completed", "tag": "a38f8fd7-717d-49a5-8003-162021ff7c63"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:21.205173 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-1dfa529a-8abb-4393-8d46-7961311f9975 req-36f164d4-9a47-41c2-97ef-a187b069ff1b service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:21.205558 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-1dfa529a-8abb-4393-8d46-7961311f9975 req-36f164d4-9a47-41c2-97ef-a187b069ff1b service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:21.217430 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-1dfa529a-8abb-4393-8d46-7961311f9975 req-36f164d4-9a47-41c2-97ef-a187b069ff1b service nova] Creating event network-vif-plugged:a38f8fd7-717d-49a5-8003-162021ff7c63 for instance 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c on hv-cinder-83716 Jun 16 15:00:21.222276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-1dfa529a-8abb-4393-8d46-7961311f9975 req-36f164d4-9a47-41c2-97ef-a187b069ff1b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030885 Jun 16 15:00:21.222894 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 361/723] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:21.256500 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c57dd691-d8b3-49ba-bf71-17e71ffbe611 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:21.257170 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c57dd691-d8b3-49ba-bf71-17e71ffbe611 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:21.264421 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c57dd691-d8b3-49ba-bf71-17e71ffbe611 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:21.265197 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c57dd691-d8b3-49ba-bf71-17e71ffbe611 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:21.266193 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c57dd691-d8b3-49ba-bf71-17e71ffbe611 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:21.266640 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c57dd691-d8b3-49ba-bf71-17e71ffbe611 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:21.271153 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:21.410410 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c57dd691-d8b3-49ba-bf71-17e71ffbe611 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:21.418566 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c57dd691-d8b3-49ba-bf71-17e71ffbe611 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.165748 Jun 16 15:00:21.419133 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 363/724] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:21 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:21.544608 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7e88b7c5-3e12-4b64-b17f-644906a77ba3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:21.545288 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7e88b7c5-3e12-4b64-b17f-644906a77ba3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:21.551840 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e88b7c5-3e12-4b64-b17f-644906a77ba3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:21.552281 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e88b7c5-3e12-4b64-b17f-644906a77ba3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:21.553026 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e88b7c5-3e12-4b64-b17f-644906a77ba3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:21.553448 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e88b7c5-3e12-4b64-b17f-644906a77ba3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:21.685529 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7e88b7c5-3e12-4b64-b17f-644906a77ba3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:21.693321 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7e88b7c5-3e12-4b64-b17f-644906a77ba3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1366 microversion: 2.1 time: 0.153584 Jun 16 15:00:21.693897 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 362/725] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:21 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:21.901384 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-656a8bcb-b38d-4368-8dbe-0dbde48d0591 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:21.901990 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-656a8bcb-b38d-4368-8dbe-0dbde48d0591 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:21.909184 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-656a8bcb-b38d-4368-8dbe-0dbde48d0591 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:21.909637 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-656a8bcb-b38d-4368-8dbe-0dbde48d0591 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:21.910412 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-656a8bcb-b38d-4368-8dbe-0dbde48d0591 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:21.910850 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-656a8bcb-b38d-4368-8dbe-0dbde48d0591 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:22.054958 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-656a8bcb-b38d-4368-8dbe-0dbde48d0591 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:22.064599 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-656a8bcb-b38d-4368-8dbe-0dbde48d0591 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1755 microversion: 2.1 time: 0.167007 Jun 16 15:00:22.065437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 364/726] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:21 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:22.435750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-bedcde8c-3eaa-4f5a-9410-268357c11df1 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:22.437129 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-bedcde8c-3eaa-4f5a-9410-268357c11df1 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:22.438349 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=2 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:22.439034 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=6 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:22.444663 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bedcde8c-3eaa-4f5a-9410-268357c11df1 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:22.445104 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bedcde8c-3eaa-4f5a-9410-268357c11df1 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:22.445863 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bedcde8c-3eaa-4f5a-9410-268357c11df1 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:22.446287 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bedcde8c-3eaa-4f5a-9410-268357c11df1 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:22.582154 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-bedcde8c-3eaa-4f5a-9410-268357c11df1 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:22.585562 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:22.591049 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-bedcde8c-3eaa-4f5a-9410-268357c11df1 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.159680 Jun 16 15:00:22.591617 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 363/727] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:22 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:22.710708 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0081f2a0-bb8e-4a62-9ffb-2e3297d048f9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:22.711424 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0081f2a0-bb8e-4a62-9ffb-2e3297d048f9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:22.713877 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=6 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:22.719220 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0081f2a0-bb8e-4a62-9ffb-2e3297d048f9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:22.719950 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0081f2a0-bb8e-4a62-9ffb-2e3297d048f9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:22.720728 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0081f2a0-bb8e-4a62-9ffb-2e3297d048f9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:22.721169 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0081f2a0-bb8e-4a62-9ffb-2e3297d048f9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:22.856039 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0081f2a0-bb8e-4a62-9ffb-2e3297d048f9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:22.863530 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0081f2a0-bb8e-4a62-9ffb-2e3297d048f9 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1366 microversion: 2.1 time: 0.156689 Jun 16 15:00:22.864130 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 365/728] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:22 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:23.082403 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-49a8fc2b-7e1b-425c-aba9-f65a9ee845e7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:23.083020 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-49a8fc2b-7e1b-425c-aba9-f65a9ee845e7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:23.089947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-49a8fc2b-7e1b-425c-aba9-f65a9ee845e7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:23.090389 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-49a8fc2b-7e1b-425c-aba9-f65a9ee845e7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:23.091147 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-49a8fc2b-7e1b-425c-aba9-f65a9ee845e7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:23.091572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-49a8fc2b-7e1b-425c-aba9-f65a9ee845e7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:23.256080 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-49a8fc2b-7e1b-425c-aba9-f65a9ee845e7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:23.264090 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-49a8fc2b-7e1b-425c-aba9-f65a9ee845e7 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1755 microversion: 2.1 time: 0.185547 Jun 16 15:00:23.264652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 364/729] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:23 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:23.608629 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-266aec9e-abb5-4c89-82f3-d42902a11705 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:23.609231 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-266aec9e-abb5-4c89-82f3-d42902a11705 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:23.615289 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-266aec9e-abb5-4c89-82f3-d42902a11705 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:23.615779 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-266aec9e-abb5-4c89-82f3-d42902a11705 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:23.616542 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-266aec9e-abb5-4c89-82f3-d42902a11705 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:23.616976 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-266aec9e-abb5-4c89-82f3-d42902a11705 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:23.749449 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-266aec9e-abb5-4c89-82f3-d42902a11705 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:23.757181 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-266aec9e-abb5-4c89-82f3-d42902a11705 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.153087 Jun 16 15:00:23.757740 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 366/730] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:23 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:23.880982 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-53359cc7-1f03-4f3b-aa0b-85c31d169d2f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:23.881555 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-53359cc7-1f03-4f3b-aa0b-85c31d169d2f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:23.888484 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-53359cc7-1f03-4f3b-aa0b-85c31d169d2f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:23.888932 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-53359cc7-1f03-4f3b-aa0b-85c31d169d2f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:23.889690 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-53359cc7-1f03-4f3b-aa0b-85c31d169d2f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:23.890123 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-53359cc7-1f03-4f3b-aa0b-85c31d169d2f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:24.021455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-53359cc7-1f03-4f3b-aa0b-85c31d169d2f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:24.029506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-53359cc7-1f03-4f3b-aa0b-85c31d169d2f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1366 microversion: 2.1 time: 0.152544 Jun 16 15:00:24.030064 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 365/731] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:23 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:24.282641 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4079a364-eff6-47e2-9d51-89e2a7d39fcd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:24.283548 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4079a364-eff6-47e2-9d51-89e2a7d39fcd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:24.289778 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4079a364-eff6-47e2-9d51-89e2a7d39fcd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:24.290302 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4079a364-eff6-47e2-9d51-89e2a7d39fcd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:24.291279 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4079a364-eff6-47e2-9d51-89e2a7d39fcd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:24.291825 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4079a364-eff6-47e2-9d51-89e2a7d39fcd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:24.450293 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4079a364-eff6-47e2-9d51-89e2a7d39fcd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:24.458716 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4079a364-eff6-47e2-9d51-89e2a7d39fcd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1755 microversion: 2.1 time: 0.180212 Jun 16 15:00:24.459290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 367/732] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:24 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:24.774400 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-aa71f168-5f49-46a4-b9c2-d87c3f0d1cc2 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:24.775000 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-aa71f168-5f49-46a4-b9c2-d87c3f0d1cc2 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:24.781094 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aa71f168-5f49-46a4-b9c2-d87c3f0d1cc2 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:24.781537 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aa71f168-5f49-46a4-b9c2-d87c3f0d1cc2 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:24.782542 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aa71f168-5f49-46a4-b9c2-d87c3f0d1cc2 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:24.782972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aa71f168-5f49-46a4-b9c2-d87c3f0d1cc2 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:24.968126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-aa71f168-5f49-46a4-b9c2-d87c3f0d1cc2 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:24.976839 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-aa71f168-5f49-46a4-b9c2-d87c3f0d1cc2 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.206228 Jun 16 15:00:24.977412 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 366/733] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:24 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:25.046926 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9180364c-2908-4620-93a2-b59ad777d845 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:25.047529 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9180364c-2908-4620-93a2-b59ad777d845 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:25.054264 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9180364c-2908-4620-93a2-b59ad777d845 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:25.054732 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9180364c-2908-4620-93a2-b59ad777d845 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:25.055471 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9180364c-2908-4620-93a2-b59ad777d845 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:25.055938 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9180364c-2908-4620-93a2-b59ad777d845 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:25.199089 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9180364c-2908-4620-93a2-b59ad777d845 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:25.212899 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9180364c-2908-4620-93a2-b59ad777d845 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1366 microversion: 2.1 time: 0.169717 Jun 16 15:00:25.215075 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 368/734] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:25 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:25.477236 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7de06ee2-f476-4848-9873-de0203cd9634 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:25.477938 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7de06ee2-f476-4848-9873-de0203cd9634 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:25.485160 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7de06ee2-f476-4848-9873-de0203cd9634 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:25.485609 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7de06ee2-f476-4848-9873-de0203cd9634 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:25.486448 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7de06ee2-f476-4848-9873-de0203cd9634 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:25.486994 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7de06ee2-f476-4848-9873-de0203cd9634 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:25.653943 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7de06ee2-f476-4848-9873-de0203cd9634 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:25.662137 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7de06ee2-f476-4848-9873-de0203cd9634 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1755 microversion: 2.1 time: 0.189000 Jun 16 15:00:25.662709 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 367/735] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:25 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:25.995541 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-dd827c3c-c54a-40bb-ac05-7dbd81882970 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:25.996420 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-dd827c3c-c54a-40bb-ac05-7dbd81882970 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:26.003555 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dd827c3c-c54a-40bb-ac05-7dbd81882970 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:26.004104 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dd827c3c-c54a-40bb-ac05-7dbd81882970 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:26.004954 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dd827c3c-c54a-40bb-ac05-7dbd81882970 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:26.005468 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dd827c3c-c54a-40bb-ac05-7dbd81882970 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:26.029000 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-35a6a7a6-8b27-4c0b-a3a6-848f29e20355 req-bdf15abd-969b-4555-b677-8c1be1a968d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d7f1ee-c351-40d2-8751-bbb43c7e4a57", "name": "network-vif-plugged", "status": "completed", "tag": "f79eb32a-fc6a-4e9d-b58c-8d301cf85cf9"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:26.038149 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-35a6a7a6-8b27-4c0b-a3a6-848f29e20355 req-bdf15abd-969b-4555-b677-8c1be1a968d4 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:26.038596 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-35a6a7a6-8b27-4c0b-a3a6-848f29e20355 req-bdf15abd-969b-4555-b677-8c1be1a968d4 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:26.051426 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-35a6a7a6-8b27-4c0b-a3a6-848f29e20355 req-bdf15abd-969b-4555-b677-8c1be1a968d4 service nova] Creating event network-vif-plugged:f79eb32a-fc6a-4e9d-b58c-8d301cf85cf9 for instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 on hv-cinder-83716 Jun 16 15:00:26.056792 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-35a6a7a6-8b27-4c0b-a3a6-848f29e20355 req-bdf15abd-969b-4555-b677-8c1be1a968d4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032086 Jun 16 15:00:26.057389 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 368/736] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:00:26.148014 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-dd827c3c-c54a-40bb-ac05-7dbd81882970 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:26.156372 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-dd827c3c-c54a-40bb-ac05-7dbd81882970 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1259 microversion: 2.1 time: 0.165632 Jun 16 15:00:26.157192 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 369/737] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:25 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:26.231361 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-80576183-6e7b-4495-805e-c265d084b971 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:26.232084 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-80576183-6e7b-4495-805e-c265d084b971 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:26.239191 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-80576183-6e7b-4495-805e-c265d084b971 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:26.239635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-80576183-6e7b-4495-805e-c265d084b971 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:26.240456 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-80576183-6e7b-4495-805e-c265d084b971 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:26.240884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-80576183-6e7b-4495-805e-c265d084b971 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:26.386913 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-80576183-6e7b-4495-805e-c265d084b971 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:26.395355 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-80576183-6e7b-4495-805e-c265d084b971 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1366 microversion: 2.1 time: 0.168574 Jun 16 15:00:26.396137 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 369/738] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:26 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:26.503844 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ef1e2f17-e5f0-4d71-938e-07bce61356ea tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:26.504948 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ef1e2f17-e5f0-4d71-938e-07bce61356ea tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:26.513915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ef1e2f17-e5f0-4d71-938e-07bce61356ea tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:26.514448 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ef1e2f17-e5f0-4d71-938e-07bce61356ea tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:26.515431 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ef1e2f17-e5f0-4d71-938e-07bce61356ea tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:26.516096 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ef1e2f17-e5f0-4d71-938e-07bce61356ea tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:26.540411 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-ef1e2f17-e5f0-4d71-938e-07bce61356ea tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lazy-loading 'flavor' on Instance uuid b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:00:26.681581 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b3c3916a-b765-4693-b83e-5d3fb3d5fa06 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:26.682192 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b3c3916a-b765-4693-b83e-5d3fb3d5fa06 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:26.696223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b3c3916a-b765-4693-b83e-5d3fb3d5fa06 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:26.696905 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b3c3916a-b765-4693-b83e-5d3fb3d5fa06 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:26.699923 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b3c3916a-b765-4693-b83e-5d3fb3d5fa06 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:26.700529 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ef1e2f17-e5f0-4d71-938e-07bce61356ea tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "POST /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/action" status: 200 len: 32 microversion: 2.1 time: 0.201255 Jun 16 15:00:26.700650 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b3c3916a-b765-4693-b83e-5d3fb3d5fa06 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:26.701469 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 370/739] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Jun 16 15:00:26 2022] POST /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/action => generated 32 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 15:00:26.711935 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-de917bbd-3349-467b-b763-3a5574edf4c5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:26.712648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-de917bbd-3349-467b-b763-3a5574edf4c5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:26.719523 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:26.722503 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-de917bbd-3349-467b-b763-3a5574edf4c5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:26.722979 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-de917bbd-3349-467b-b763-3a5574edf4c5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:26.723873 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-de917bbd-3349-467b-b763-3a5574edf4c5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:26.724540 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-de917bbd-3349-467b-b763-3a5574edf4c5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:26.946642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b3c3916a-b765-4693-b83e-5d3fb3d5fa06 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:26.950633 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-de917bbd-3349-467b-b763-3a5574edf4c5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:26.954818 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b3c3916a-b765-4693-b83e-5d3fb3d5fa06 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1755 microversion: 2.1 time: 0.277279 Jun 16 15:00:26.955385 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 370/740] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:26 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1755 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:26.959024 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-de917bbd-3349-467b-b763-3a5574edf4c5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.251798 Jun 16 15:00:26.959573 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 371/741] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:26 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:27.174932 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-111a6701-2fbe-4ecf-877d-89609caecf94 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:27.175476 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-111a6701-2fbe-4ecf-877d-89609caecf94 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:27.181886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-111a6701-2fbe-4ecf-877d-89609caecf94 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:27.182334 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-111a6701-2fbe-4ecf-877d-89609caecf94 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:27.183092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-111a6701-2fbe-4ecf-877d-89609caecf94 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:27.183528 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-111a6701-2fbe-4ecf-877d-89609caecf94 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:27.343923 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-111a6701-2fbe-4ecf-877d-89609caecf94 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:27.351827 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-111a6701-2fbe-4ecf-877d-89609caecf94 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1443 microversion: 2.1 time: 0.180865 Jun 16 15:00:27.352392 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 371/742] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:27 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1443 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:27.369178 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a6fb14a9-e145-4819-a696-8f349b14cb73 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:27.369887 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a6fb14a9-e145-4819-a696-8f349b14cb73 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:27.376460 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a6fb14a9-e145-4819-a696-8f349b14cb73 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:27.376907 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a6fb14a9-e145-4819-a696-8f349b14cb73 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:27.377674 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a6fb14a9-e145-4819-a696-8f349b14cb73 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:27.378109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a6fb14a9-e145-4819-a696-8f349b14cb73 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:27.413072 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f7ce8644-fbac-4616-9c36-17b07eacebbd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:27.413958 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f7ce8644-fbac-4616-9c36-17b07eacebbd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:27.422322 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f7ce8644-fbac-4616-9c36-17b07eacebbd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:27.422868 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f7ce8644-fbac-4616-9c36-17b07eacebbd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:27.424038 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f7ce8644-fbac-4616-9c36-17b07eacebbd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:27.424706 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f7ce8644-fbac-4616-9c36-17b07eacebbd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:27.829598 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a6fb14a9-e145-4819-a696-8f349b14cb73 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:27.832571 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f7ce8644-fbac-4616-9c36-17b07eacebbd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:27.841539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a6fb14a9-e145-4819-a696-8f349b14cb73 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1443 microversion: 2.1 time: 0.477102 Jun 16 15:00:27.841724 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f7ce8644-fbac-4616-9c36-17b07eacebbd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1366 microversion: 2.1 time: 0.432566 Jun 16 15:00:27.849523 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 372/743] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:27 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1366 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:27.849692 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 372/744] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:27 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1443 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:27.972720 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ad565149-85e2-4fb8-b5fa-efaf4a3beb28 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:27.973341 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ad565149-85e2-4fb8-b5fa-efaf4a3beb28 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:27.976518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-da3da39f-a62a-438e-8ceb-765e4d0afb86 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:27.977356 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-da3da39f-a62a-438e-8ceb-765e4d0afb86 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:27.979403 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ad565149-85e2-4fb8-b5fa-efaf4a3beb28 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:27.979900 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ad565149-85e2-4fb8-b5fa-efaf4a3beb28 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:27.980701 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ad565149-85e2-4fb8-b5fa-efaf4a3beb28 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:27.981141 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ad565149-85e2-4fb8-b5fa-efaf4a3beb28 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:27.983495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-da3da39f-a62a-438e-8ceb-765e4d0afb86 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:27.984217 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-da3da39f-a62a-438e-8ceb-765e4d0afb86 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:27.985020 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-da3da39f-a62a-438e-8ceb-765e4d0afb86 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:27.986858 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-da3da39f-a62a-438e-8ceb-765e4d0afb86 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:28.191888 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-da3da39f-a62a-438e-8ceb-765e4d0afb86 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:28.201567 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-da3da39f-a62a-438e-8ceb-765e4d0afb86 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.229102 Jun 16 15:00:28.202392 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 373/745] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:27 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:28.207556 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ad565149-85e2-4fb8-b5fa-efaf4a3beb28 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:28.215948 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ad565149-85e2-4fb8-b5fa-efaf4a3beb28 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1755 microversion: 2.1 time: 0.247396 Jun 16 15:00:28.216525 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 373/746] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:27 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1755 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:28.859492 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c1c3cc58-af07-4bd6-8637-8a06f2536071 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:28.860235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c1c3cc58-af07-4bd6-8637-8a06f2536071 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:28.866724 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c1c3cc58-af07-4bd6-8637-8a06f2536071 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:28.867223 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c1c3cc58-af07-4bd6-8637-8a06f2536071 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:28.868151 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c1c3cc58-af07-4bd6-8637-8a06f2536071 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:28.868659 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c1c3cc58-af07-4bd6-8637-8a06f2536071 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:29.048789 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c1c3cc58-af07-4bd6-8637-8a06f2536071 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:29.058598 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c1c3cc58-af07-4bd6-8637-8a06f2536071 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1366 microversion: 2.1 time: 0.203807 Jun 16 15:00:29.059432 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 374/747] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:28 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:29.232346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f313b906-8021-4152-975d-1899c8f8fe70 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:29.233001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f313b906-8021-4152-975d-1899c8f8fe70 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:29.233870 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6abdf9b7-eee2-4c79-ba0b-9f4318b03cce tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:29.234507 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6abdf9b7-eee2-4c79-ba0b-9f4318b03cce tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:29.241578 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6abdf9b7-eee2-4c79-ba0b-9f4318b03cce tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:29.241964 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6abdf9b7-eee2-4c79-ba0b-9f4318b03cce tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:29.242727 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6abdf9b7-eee2-4c79-ba0b-9f4318b03cce tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:29.243162 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6abdf9b7-eee2-4c79-ba0b-9f4318b03cce tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:29.243704 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f313b906-8021-4152-975d-1899c8f8fe70 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:29.251644 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f313b906-8021-4152-975d-1899c8f8fe70 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:29.252504 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f313b906-8021-4152-975d-1899c8f8fe70 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:29.253026 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f313b906-8021-4152-975d-1899c8f8fe70 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:29.489919 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f313b906-8021-4152-975d-1899c8f8fe70 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:29.494493 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6abdf9b7-eee2-4c79-ba0b-9f4318b03cce tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:29.503507 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6abdf9b7-eee2-4c79-ba0b-9f4318b03cce tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1755 microversion: 2.1 time: 0.273511 Jun 16 15:00:29.504138 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 375/748] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:29 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1755 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:29.504958 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f313b906-8021-4152-975d-1899c8f8fe70 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.287977 Jun 16 15:00:29.505679 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 374/749] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:29 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:30.076425 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c3eb24d9-a6a2-4d75-953e-921ff17965bc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:30.077703 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c3eb24d9-a6a2-4d75-953e-921ff17965bc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:30.084025 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c3eb24d9-a6a2-4d75-953e-921ff17965bc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:30.084495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c3eb24d9-a6a2-4d75-953e-921ff17965bc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:30.085270 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c3eb24d9-a6a2-4d75-953e-921ff17965bc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:30.085767 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c3eb24d9-a6a2-4d75-953e-921ff17965bc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:30.221685 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-37af6c20-2478-4e57-b1e1-0c4a99e2b6b3 req-f9d5af38-53d4-4ed6-8217-714f41955df2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c", "tag": "a38f8fd7-717d-49a5-8003-162021ff7c63"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:30.231178 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-37af6c20-2478-4e57-b1e1-0c4a99e2b6b3 req-f9d5af38-53d4-4ed6-8217-714f41955df2 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:30.231921 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-37af6c20-2478-4e57-b1e1-0c4a99e2b6b3 req-f9d5af38-53d4-4ed6-8217-714f41955df2 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:30.237617 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c3eb24d9-a6a2-4d75-953e-921ff17965bc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:30.244008 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-37af6c20-2478-4e57-b1e1-0c4a99e2b6b3 req-f9d5af38-53d4-4ed6-8217-714f41955df2 service nova] Creating event network-changed:a38f8fd7-717d-49a5-8003-162021ff7c63 for instance 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c on hv-cinder-83716 Jun 16 15:00:30.246788 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c3eb24d9-a6a2-4d75-953e-921ff17965bc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1555 microversion: 2.1 time: 0.174636 Jun 16 15:00:30.247904 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 376/750] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:30 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:30.249780 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-37af6c20-2478-4e57-b1e1-0c4a99e2b6b3 req-f9d5af38-53d4-4ed6-8217-714f41955df2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031809 Jun 16 15:00:30.250363 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 375/751] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:00:30.264738 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2700b131-b19f-4389-85b7-50acd432b441 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:30.265235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2700b131-b19f-4389-85b7-50acd432b441 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:30.271562 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2700b131-b19f-4389-85b7-50acd432b441 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:30.272048 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2700b131-b19f-4389-85b7-50acd432b441 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:30.272817 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2700b131-b19f-4389-85b7-50acd432b441 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:30.273250 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2700b131-b19f-4389-85b7-50acd432b441 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:30.368021 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2700b131-b19f-4389-85b7-50acd432b441 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106790 Jun 16 15:00:30.370506 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 377/752] 10.222.0.76 () {58 vars in 1274 bytes} [Thu Jun 16 15:00:30 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:30.522039 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1842473c-1774-48de-a287-191f64d531f6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:30.522670 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-59eb28d3-2430-438c-8bff-b4f4607ea40f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:30.523227 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-1842473c-1774-48de-a287-191f64d531f6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:30.523379 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-59eb28d3-2430-438c-8bff-b4f4607ea40f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:30.530545 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-59eb28d3-2430-438c-8bff-b4f4607ea40f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:30.530827 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1842473c-1774-48de-a287-191f64d531f6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:30.531034 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1842473c-1774-48de-a287-191f64d531f6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:30.531817 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1842473c-1774-48de-a287-191f64d531f6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:30.532338 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-59eb28d3-2430-438c-8bff-b4f4607ea40f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:30.532518 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1842473c-1774-48de-a287-191f64d531f6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:30.534100 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-59eb28d3-2430-438c-8bff-b4f4607ea40f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:30.534927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-59eb28d3-2430-438c-8bff-b4f4607ea40f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:30.540394 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:30.767157 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-59eb28d3-2430-438c-8bff-b4f4607ea40f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:30.777882 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-59eb28d3-2430-438c-8bff-b4f4607ea40f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.258597 Jun 16 15:00:30.778649 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1842473c-1774-48de-a287-191f64d531f6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:30.778809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 378/753] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:30 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:30.789811 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1842473c-1774-48de-a287-191f64d531f6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1755 microversion: 2.1 time: 0.271858 Jun 16 15:00:30.799187 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 376/754] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:30 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1755 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:31.796982 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-00c4ccba-b3f2-429e-a040-c987f88ceb56 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:31.797724 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-00c4ccba-b3f2-429e-a040-c987f88ceb56 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:31.804889 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-00c4ccba-b3f2-429e-a040-c987f88ceb56 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:31.805557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-00c4ccba-b3f2-429e-a040-c987f88ceb56 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:31.806891 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-00c4ccba-b3f2-429e-a040-c987f88ceb56 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:31.807384 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-00c4ccba-b3f2-429e-a040-c987f88ceb56 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:31.807608 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-240a2ec8-d930-4e70-b352-1448fe4e6fde tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:31.808259 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-240a2ec8-d930-4e70-b352-1448fe4e6fde tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:31.815007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-240a2ec8-d930-4e70-b352-1448fe4e6fde tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:31.815453 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-240a2ec8-d930-4e70-b352-1448fe4e6fde tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:31.816261 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-240a2ec8-d930-4e70-b352-1448fe4e6fde tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:31.816691 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-240a2ec8-d930-4e70-b352-1448fe4e6fde tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:32.023409 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-00c4ccba-b3f2-429e-a040-c987f88ceb56 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:32.042728 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-240a2ec8-d930-4e70-b352-1448fe4e6fde tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:32.050408 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-00c4ccba-b3f2-429e-a040-c987f88ceb56 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.257445 Jun 16 15:00:32.051458 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 379/755] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:31 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:32.054633 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-240a2ec8-d930-4e70-b352-1448fe4e6fde tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1755 microversion: 2.1 time: 0.251622 Jun 16 15:00:32.055503 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 377/756] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:31 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1755 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:32.265922 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-7086ce88-5ada-407a-84a5-16338bea328f req-cf6b0858-63f8-4437-9265-18b20d255a5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4d7f1ee-c351-40d2-8751-bbb43c7e4a57", "tag": "f79eb32a-fc6a-4e9d-b58c-8d301cf85cf9"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:32.276005 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-7086ce88-5ada-407a-84a5-16338bea328f req-cf6b0858-63f8-4437-9265-18b20d255a5c service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:32.276715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-7086ce88-5ada-407a-84a5-16338bea328f req-cf6b0858-63f8-4437-9265-18b20d255a5c service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:32.290467 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-7086ce88-5ada-407a-84a5-16338bea328f req-cf6b0858-63f8-4437-9265-18b20d255a5c service nova] Creating event network-changed:f79eb32a-fc6a-4e9d-b58c-8d301cf85cf9 for instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 on hv-cinder-83716 Jun 16 15:00:32.295803 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-7086ce88-5ada-407a-84a5-16338bea328f req-cf6b0858-63f8-4437-9265-18b20d255a5c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034584 Jun 16 15:00:32.296553 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 380/757] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:33.080335 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-72b15b1d-6b6b-46d8-80d2-3852aa6d37eb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:33.081202 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-72b15b1d-6b6b-46d8-80d2-3852aa6d37eb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:33.084707 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f7d8fb32-0c6b-4264-a49d-bfa819f0f7dd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:33.085855 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f7d8fb32-0c6b-4264-a49d-bfa819f0f7dd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:33.088152 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-72b15b1d-6b6b-46d8-80d2-3852aa6d37eb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:33.088600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-72b15b1d-6b6b-46d8-80d2-3852aa6d37eb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:33.089371 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-72b15b1d-6b6b-46d8-80d2-3852aa6d37eb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:33.090332 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-72b15b1d-6b6b-46d8-80d2-3852aa6d37eb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:33.093195 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f7d8fb32-0c6b-4264-a49d-bfa819f0f7dd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:33.093831 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f7d8fb32-0c6b-4264-a49d-bfa819f0f7dd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:33.094613 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f7d8fb32-0c6b-4264-a49d-bfa819f0f7dd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:33.095120 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f7d8fb32-0c6b-4264-a49d-bfa819f0f7dd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:33.304336 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-72b15b1d-6b6b-46d8-80d2-3852aa6d37eb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:33.315629 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-72b15b1d-6b6b-46d8-80d2-3852aa6d37eb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.239814 Jun 16 15:00:33.319496 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f7d8fb32-0c6b-4264-a49d-bfa819f0f7dd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:33.324955 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 381/758] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:33 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:33.331305 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f7d8fb32-0c6b-4264-a49d-bfa819f0f7dd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1755 microversion: 2.1 time: 0.255930 Jun 16 15:00:33.332073 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 378/759] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:33 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1755 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:34.341987 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-dd64d40a-a2b3-488a-8d2a-04ac4c888a30 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:34.342587 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-dd64d40a-a2b3-488a-8d2a-04ac4c888a30 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:34.348762 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-9c3d9f0f-7be3-4873-9d93-ed8edfa42682 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:34.349233 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dd64d40a-a2b3-488a-8d2a-04ac4c888a30 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:34.349509 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-9c3d9f0f-7be3-4873-9d93-ed8edfa42682 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:34.349624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dd64d40a-a2b3-488a-8d2a-04ac4c888a30 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:34.350321 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dd64d40a-a2b3-488a-8d2a-04ac4c888a30 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:34.350747 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dd64d40a-a2b3-488a-8d2a-04ac4c888a30 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:34.356656 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9c3d9f0f-7be3-4873-9d93-ed8edfa42682 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:34.357109 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9c3d9f0f-7be3-4873-9d93-ed8edfa42682 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:34.357877 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9c3d9f0f-7be3-4873-9d93-ed8edfa42682 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:34.358310 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9c3d9f0f-7be3-4873-9d93-ed8edfa42682 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:34.565787 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-dd64d40a-a2b3-488a-8d2a-04ac4c888a30 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:34.570501 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-9c3d9f0f-7be3-4873-9d93-ed8edfa42682 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:34.573867 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-dd64d40a-a2b3-488a-8d2a-04ac4c888a30 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.236131 Jun 16 15:00:34.574442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 382/760] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:34 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:34.578967 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-9c3d9f0f-7be3-4873-9d93-ed8edfa42682 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1755 microversion: 2.1 time: 0.233952 Jun 16 15:00:34.579616 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 379/761] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:34 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1755 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:35.592186 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-df260a10-b259-4eba-8ee7-434c6efd683f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:35.594417 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-df260a10-b259-4eba-8ee7-434c6efd683f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:35.598282 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-12647d60-e6e9-4261-bb8c-4b7a22d7109b tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:35.598946 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-12647d60-e6e9-4261-bb8c-4b7a22d7109b tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:35.605516 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-df260a10-b259-4eba-8ee7-434c6efd683f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:35.606784 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-df260a10-b259-4eba-8ee7-434c6efd683f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:35.608423 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-df260a10-b259-4eba-8ee7-434c6efd683f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:35.608566 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-12647d60-e6e9-4261-bb8c-4b7a22d7109b tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:35.609051 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-df260a10-b259-4eba-8ee7-434c6efd683f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:35.609185 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-12647d60-e6e9-4261-bb8c-4b7a22d7109b tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:35.610084 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-12647d60-e6e9-4261-bb8c-4b7a22d7109b tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:35.610675 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-12647d60-e6e9-4261-bb8c-4b7a22d7109b tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:36.060348 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-df260a10-b259-4eba-8ee7-434c6efd683f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:36.062054 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-12647d60-e6e9-4261-bb8c-4b7a22d7109b tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:36.063735 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-df260a10-b259-4eba-8ee7-434c6efd683f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.477030 Jun 16 15:00:36.064585 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 383/762] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:35 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:36.078613 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-12647d60-e6e9-4261-bb8c-4b7a22d7109b tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1758 microversion: 2.1 time: 0.485710 Jun 16 15:00:36.079289 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 380/763] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:35 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1758 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:37.081353 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ad794901-eba9-421e-9d2f-fdef5e6b843d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:37.081966 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ad794901-eba9-421e-9d2f-fdef5e6b843d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:37.088546 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ad794901-eba9-421e-9d2f-fdef5e6b843d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:37.088984 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ad794901-eba9-421e-9d2f-fdef5e6b843d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:37.089768 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ad794901-eba9-421e-9d2f-fdef5e6b843d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:37.090200 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ad794901-eba9-421e-9d2f-fdef5e6b843d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:37.222198 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ad794901-eba9-421e-9d2f-fdef5e6b843d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:37.230029 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ad794901-eba9-421e-9d2f-fdef5e6b843d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.152609 Jun 16 15:00:37.230581 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 384/764] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:37 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:38.247589 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a46aacaa-86be-4ec2-84f5-66b1e073b0fc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:38.248214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a46aacaa-86be-4ec2-84f5-66b1e073b0fc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:38.254804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a46aacaa-86be-4ec2-84f5-66b1e073b0fc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:38.255250 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a46aacaa-86be-4ec2-84f5-66b1e073b0fc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:38.256045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a46aacaa-86be-4ec2-84f5-66b1e073b0fc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:38.256481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a46aacaa-86be-4ec2-84f5-66b1e073b0fc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:38.385117 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a46aacaa-86be-4ec2-84f5-66b1e073b0fc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:38.389191 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=100 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:38.394343 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a46aacaa-86be-4ec2-84f5-66b1e073b0fc tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.151164 Jun 16 15:00:38.394905 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 381/765] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:38 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:39.411532 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a421d60f-0eae-4dbc-8e84-fef27659ea88 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:39.412165 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a421d60f-0eae-4dbc-8e84-fef27659ea88 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:39.419473 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a421d60f-0eae-4dbc-8e84-fef27659ea88 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:39.419947 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a421d60f-0eae-4dbc-8e84-fef27659ea88 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:39.420714 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a421d60f-0eae-4dbc-8e84-fef27659ea88 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:39.421155 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a421d60f-0eae-4dbc-8e84-fef27659ea88 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:39.548017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a421d60f-0eae-4dbc-8e84-fef27659ea88 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:39.555934 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a421d60f-0eae-4dbc-8e84-fef27659ea88 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.148518 Jun 16 15:00:39.556507 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 385/766] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:39 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:40.573441 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6788e3f6-9532-4c0a-b6ec-48ec6641cc3d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:40.573960 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6788e3f6-9532-4c0a-b6ec-48ec6641cc3d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:40.580660 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6788e3f6-9532-4c0a-b6ec-48ec6641cc3d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:40.581096 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6788e3f6-9532-4c0a-b6ec-48ec6641cc3d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:40.581846 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6788e3f6-9532-4c0a-b6ec-48ec6641cc3d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:40.582272 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6788e3f6-9532-4c0a-b6ec-48ec6641cc3d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:40.716068 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6788e3f6-9532-4c0a-b6ec-48ec6641cc3d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:40.724003 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6788e3f6-9532-4c0a-b6ec-48ec6641cc3d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.154606 Jun 16 15:00:40.724570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 382/767] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:40 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:41.741758 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-779b78d0-fcb2-4fe8-b074-c7b3d45ef7ab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:41.742357 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-779b78d0-fcb2-4fe8-b074-c7b3d45ef7ab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:41.749342 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-779b78d0-fcb2-4fe8-b074-c7b3d45ef7ab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:41.749792 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-779b78d0-fcb2-4fe8-b074-c7b3d45ef7ab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:41.750549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-779b78d0-fcb2-4fe8-b074-c7b3d45ef7ab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:41.750986 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-779b78d0-fcb2-4fe8-b074-c7b3d45ef7ab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:41.884912 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-779b78d0-fcb2-4fe8-b074-c7b3d45ef7ab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:41.895111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-779b78d0-fcb2-4fe8-b074-c7b3d45ef7ab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.157202 Jun 16 15:00:41.895705 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 386/768] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:41 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:42.912823 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-67b42e09-22c2-413c-881a-de0f3f2bc723 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:42.913413 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-67b42e09-22c2-413c-881a-de0f3f2bc723 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:42.920587 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-67b42e09-22c2-413c-881a-de0f3f2bc723 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:42.921061 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-67b42e09-22c2-413c-881a-de0f3f2bc723 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:42.921824 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-67b42e09-22c2-413c-881a-de0f3f2bc723 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:42.922253 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-67b42e09-22c2-413c-881a-de0f3f2bc723 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:43.052470 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-67b42e09-22c2-413c-881a-de0f3f2bc723 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:43.060331 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-67b42e09-22c2-413c-881a-de0f3f2bc723 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.151440 Jun 16 15:00:43.060891 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 383/769] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:42 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:44.077601 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-41406167-d786-440a-83c8-db10901a68da tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:44.078352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-41406167-d786-440a-83c8-db10901a68da tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:44.085708 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-41406167-d786-440a-83c8-db10901a68da tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:44.086143 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-41406167-d786-440a-83c8-db10901a68da tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:44.087008 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-41406167-d786-440a-83c8-db10901a68da tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:44.087445 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-41406167-d786-440a-83c8-db10901a68da tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:44.221211 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-41406167-d786-440a-83c8-db10901a68da tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:44.231034 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-41406167-d786-440a-83c8-db10901a68da tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.157404 Jun 16 15:00:44.231602 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 387/770] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:44 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:45.248752 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6f386dd1-597e-4b6b-a6ef-8469458cd931 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:45.249354 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6f386dd1-597e-4b6b-a6ef-8469458cd931 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:45.256007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6f386dd1-597e-4b6b-a6ef-8469458cd931 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:45.256459 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6f386dd1-597e-4b6b-a6ef-8469458cd931 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:45.257347 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6f386dd1-597e-4b6b-a6ef-8469458cd931 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:45.257743 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6f386dd1-597e-4b6b-a6ef-8469458cd931 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:45.394248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6f386dd1-597e-4b6b-a6ef-8469458cd931 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:45.405160 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6f386dd1-597e-4b6b-a6ef-8469458cd931 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.160430 Jun 16 15:00:45.405796 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 384/771] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:45 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:46.423003 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4cbf95dd-ea8e-4ed4-8796-8d807db2be5a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:46.423605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4cbf95dd-ea8e-4ed4-8796-8d807db2be5a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:46.430056 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4cbf95dd-ea8e-4ed4-8796-8d807db2be5a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:46.430502 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4cbf95dd-ea8e-4ed4-8796-8d807db2be5a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:46.431260 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4cbf95dd-ea8e-4ed4-8796-8d807db2be5a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:46.431703 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4cbf95dd-ea8e-4ed4-8796-8d807db2be5a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:46.560843 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4cbf95dd-ea8e-4ed4-8796-8d807db2be5a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:46.568805 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4cbf95dd-ea8e-4ed4-8796-8d807db2be5a tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.149640 Jun 16 15:00:46.569397 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 388/772] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:46 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:47.586328 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-fd4ef5ea-89eb-4a7a-8df6-e5ef282cc392 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:47.586960 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-fd4ef5ea-89eb-4a7a-8df6-e5ef282cc392 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:47.593123 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fd4ef5ea-89eb-4a7a-8df6-e5ef282cc392 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:47.593570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fd4ef5ea-89eb-4a7a-8df6-e5ef282cc392 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:47.594331 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fd4ef5ea-89eb-4a7a-8df6-e5ef282cc392 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:47.594760 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fd4ef5ea-89eb-4a7a-8df6-e5ef282cc392 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:47.724189 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fd4ef5ea-89eb-4a7a-8df6-e5ef282cc392 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:47.732591 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-fd4ef5ea-89eb-4a7a-8df6-e5ef282cc392 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.150660 Jun 16 15:00:47.733145 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 385/773] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:47 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:48.750906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-bc550c66-6c76-4a39-bc01-e33b6bb3d545 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:48.751501 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-bc550c66-6c76-4a39-bc01-e33b6bb3d545 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:48.758063 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bc550c66-6c76-4a39-bc01-e33b6bb3d545 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:48.758515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bc550c66-6c76-4a39-bc01-e33b6bb3d545 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:48.759288 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bc550c66-6c76-4a39-bc01-e33b6bb3d545 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:48.759748 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bc550c66-6c76-4a39-bc01-e33b6bb3d545 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:48.899137 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-bc550c66-6c76-4a39-bc01-e33b6bb3d545 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:48.907046 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-bc550c66-6c76-4a39-bc01-e33b6bb3d545 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1735 microversion: 2.1 time: 0.160007 Jun 16 15:00:48.907885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 389/774] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:48 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:49.924536 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-fd87f335-5966-4828-8640-101b98069e18 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:49.925080 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-fd87f335-5966-4828-8640-101b98069e18 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:49.927346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=56 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:49.932686 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fd87f335-5966-4828-8640-101b98069e18 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:49.933137 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fd87f335-5966-4828-8640-101b98069e18 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:49.933900 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fd87f335-5966-4828-8640-101b98069e18 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:49.934336 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fd87f335-5966-4828-8640-101b98069e18 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:50.064735 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fd87f335-5966-4828-8640-101b98069e18 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:50.072604 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-fd87f335-5966-4828-8640-101b98069e18 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1715 microversion: 2.1 time: 0.152114 Jun 16 15:00:50.073157 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 386/775] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:49 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:50.178060 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6cf8101b-467e-4c9f-bc5c-b55efe8e0eea tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:50.178574 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6cf8101b-467e-4c9f-bc5c-b55efe8e0eea tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:50.185124 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6cf8101b-467e-4c9f-bc5c-b55efe8e0eea tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:50.185563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6cf8101b-467e-4c9f-bc5c-b55efe8e0eea tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:50.186315 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6cf8101b-467e-4c9f-bc5c-b55efe8e0eea tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:50.186745 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6cf8101b-467e-4c9f-bc5c-b55efe8e0eea tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:50.269723 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-6cf8101b-467e-4c9f-bc5c-b55efe8e0eea tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] HTTP exception thrown: Cannot 'detach_volume' instance b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 while it is in vm_state rescued Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6cf8101b-467e-4c9f-bc5c-b55efe8e0eea tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Request method failure captured: Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: DELETE /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/os-volume_attachments/21283df4-965b-4d19-81f0-82c4f8df7c3e HTTP/1.1 Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0R1qRdeZjEhysNNbSVHXfZB1VVu39rcbyLcnNKT_HPQerPm5L0NbB6Qe3z-V5li6ayT73_iT0ECmekPXm6SH7XxZQ69z8GSRHFIOq4NpoLwssK7wDD25ZHm4AFpyW0i1-tMmc4kBrYNcVnskigrdxbzetscFHHmV1CHIkoteDHIY7M Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 2b653a9971874ddb8a49b265e3783ff3 Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-6354083 Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:00:50.271327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:00:50.272910 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:00:50.272910 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-ServerRescueNegativeTestJSON-6354083 Jun 16 15:00:50.272910 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 2b653a9971874ddb8a49b265e3783ff3 Jun 16 15:00:50.272910 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-6354083 Jun 16 15:00:50.272910 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-ServerRescueNegativeTestJSON-6354083-project Jun 16 15:00:50.272910 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:00:50.272910 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:00:50.272910 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: dc31b47df1904f9da0b5c7f370b74132 Jun 16 15:00:50.272910 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-ServerRescueNegativeTestJSON-6354083-project Jun 16 15:00:50.272910 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:00:50.272910 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Cannot 'detach_volume' instance b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 while it is in vm_state rescued Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'server_id': 'b469ddcc-e9b1-4c39-9c75-3b98f6f624c3', 'id': '21283df4-965b-4d19-81f0-82c4f8df7c3e'} Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:00:50.273631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:00:50.274927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 15:00:50.274927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 15:00:50.274927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 15:00:50.274927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 15:00:50.274927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 while it is in vm_state rescued Jun 16 15:00:50.274927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:00:50.274927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:00:50.274927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:00:50.274927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:00:50.274927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:00:50.274927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:00:50.274927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:00:50.274927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:00:50.274927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 while it is in vm_state rescued Jun 16 15:00:50.274927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:00:50.274927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6cf8101b-467e-4c9f-bc5c-b55efe8e0eea tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Returning 409 to user: Cannot 'detach_volume' instance b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 while it is in vm_state rescued {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:00:50.275972 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6cf8101b-467e-4c9f-bc5c-b55efe8e0eea tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/os-volume_attachments/21283df4-965b-4d19-81f0-82c4f8df7c3e" status: 409 len: 152 microversion: 2.1 time: 0.098960 Jun 16 15:00:50.275972 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 390/776] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Jun 16 15:00:50 2022] DELETE /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/os-volume_attachments/21283df4-965b-4d19-81f0-82c4f8df7c3e => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 15:00:50.282476 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d58257d7-16ae-4591-85bd-90dbbf93fe03 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:50.283035 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d58257d7-16ae-4591-85bd-90dbbf93fe03 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:50.289114 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d58257d7-16ae-4591-85bd-90dbbf93fe03 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:50.289567 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d58257d7-16ae-4591-85bd-90dbbf93fe03 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:50.290356 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d58257d7-16ae-4591-85bd-90dbbf93fe03 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:50.290820 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d58257d7-16ae-4591-85bd-90dbbf93fe03 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:50.358973 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d58257d7-16ae-4591-85bd-90dbbf93fe03 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "POST /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/action" status: 202 len: 0 microversion: 2.1 time: 0.080647 Jun 16 15:00:50.359609 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 387/777] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Jun 16 15:00:50 2022] POST /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:00:50.371144 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4f86ccf5-7b41-4862-923c-f873bafb776f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:50.371913 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4f86ccf5-7b41-4862-923c-f873bafb776f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:50.380291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4f86ccf5-7b41-4862-923c-f873bafb776f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:50.381097 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4f86ccf5-7b41-4862-923c-f873bafb776f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:50.382386 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4f86ccf5-7b41-4862-923c-f873bafb776f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:50.382951 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4f86ccf5-7b41-4862-923c-f873bafb776f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:50.529826 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4f86ccf5-7b41-4862-923c-f873bafb776f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:50.538752 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4f86ccf5-7b41-4862-923c-f873bafb776f tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1723 microversion: 2.1 time: 0.174119 Jun 16 15:00:50.539470 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 391/778] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:50 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:51.558646 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7f243f2a-13a1-4271-8616-988c31c8ad01 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:51.559245 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7f243f2a-13a1-4271-8616-988c31c8ad01 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:51.565764 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7f243f2a-13a1-4271-8616-988c31c8ad01 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:51.566209 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7f243f2a-13a1-4271-8616-988c31c8ad01 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:51.566977 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7f243f2a-13a1-4271-8616-988c31c8ad01 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:51.567407 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7f243f2a-13a1-4271-8616-988c31c8ad01 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:51.704959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7f243f2a-13a1-4271-8616-988c31c8ad01 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:51.713004 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7f243f2a-13a1-4271-8616-988c31c8ad01 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1723 microversion: 2.1 time: 0.159271 Jun 16 15:00:51.713565 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 388/779] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:51 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:52.850262 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2b254c20-ec37-4453-90c8-934ecc4ab6ab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:52.850873 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2b254c20-ec37-4453-90c8-934ecc4ab6ab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:52.857171 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2b254c20-ec37-4453-90c8-934ecc4ab6ab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:52.857629 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2b254c20-ec37-4453-90c8-934ecc4ab6ab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:52.858441 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2b254c20-ec37-4453-90c8-934ecc4ab6ab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:52.858883 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2b254c20-ec37-4453-90c8-934ecc4ab6ab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:52.970935 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8ca32e8f-0578-4eae-8d9a-712ae05f438a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:52.971452 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-8ca32e8f-0578-4eae-8d9a-712ae05f438a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:52.977436 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8ca32e8f-0578-4eae-8d9a-712ae05f438a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:52.977886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8ca32e8f-0578-4eae-8d9a-712ae05f438a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:52.978940 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8ca32e8f-0578-4eae-8d9a-712ae05f438a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:52.979481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8ca32e8f-0578-4eae-8d9a-712ae05f438a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:52.999435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2b254c20-ec37-4453-90c8-934ecc4ab6ab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:53.007723 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2b254c20-ec37-4453-90c8-934ecc4ab6ab tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1723 microversion: 2.1 time: 0.281222 Jun 16 15:00:53.008072 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8ca32e8f-0578-4eae-8d9a-712ae05f438a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/os-volume_attachments/768dbc99-5f47-4394-a3e1-fbe939ee3a17" status: 200 len: 194 microversion: 2.20 time: 0.173357 Jun 16 15:00:53.008303 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 392/780] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:52 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:53.008639 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 389/781] 10.222.0.76 () {60 vars in 1453 bytes} [Thu Jun 16 15:00:52 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/os-volume_attachments/768dbc99-5f47-4394-a3e1-fbe939ee3a17 => generated 194 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 15:00:53.082634 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ef03e60f-2a9a-4031-9346-4d554a2d038a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:53.083117 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ef03e60f-2a9a-4031-9346-4d554a2d038a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:53.089716 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ef03e60f-2a9a-4031-9346-4d554a2d038a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:53.090160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ef03e60f-2a9a-4031-9346-4d554a2d038a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:53.090913 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ef03e60f-2a9a-4031-9346-4d554a2d038a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:53.091342 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ef03e60f-2a9a-4031-9346-4d554a2d038a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:53.173827 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-ef03e60f-2a9a-4031-9346-4d554a2d038a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lazy-loading 'services' on Instance uuid 663488be-459f-4a58-aa1c-82be04813a2f {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:00:53.259581 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ef03e60f-2a9a-4031-9346-4d554a2d038a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "DELETE /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/os-volume_attachments/768dbc99-5f47-4394-a3e1-fbe939ee3a17" status: 202 len: 0 microversion: 2.20 time: 0.180754 Jun 16 15:00:53.260201 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 393/782] 10.222.0.76 () {60 vars in 1456 bytes} [Thu Jun 16 15:00:53 2022] DELETE /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/os-volume_attachments/768dbc99-5f47-4394-a3e1-fbe939ee3a17 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:00:53.269365 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-79879b46-b407-48ce-a535-9220a0647214 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:53.270376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-79879b46-b407-48ce-a535-9220a0647214 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:53.276733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-79879b46-b407-48ce-a535-9220a0647214 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:53.277269 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-79879b46-b407-48ce-a535-9220a0647214 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:53.278049 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-79879b46-b407-48ce-a535-9220a0647214 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:53.278481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-79879b46-b407-48ce-a535-9220a0647214 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:53.311504 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-79879b46-b407-48ce-a535-9220a0647214 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046168 Jun 16 15:00:53.312089 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 390/783] 10.222.0.76 () {60 vars in 1342 bytes} [Thu Jun 16 15:00:53 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 15:00:54.026180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9ef9ab60-f55d-4dda-9415-7827995139aa tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:54.027509 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9ef9ab60-f55d-4dda-9415-7827995139aa tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:54.035211 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9ef9ab60-f55d-4dda-9415-7827995139aa tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:54.035720 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9ef9ab60-f55d-4dda-9415-7827995139aa tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:54.036503 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9ef9ab60-f55d-4dda-9415-7827995139aa tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:54.036977 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9ef9ab60-f55d-4dda-9415-7827995139aa tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:54.175620 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9ef9ab60-f55d-4dda-9415-7827995139aa tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:54.179205 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:54.185948 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9ef9ab60-f55d-4dda-9415-7827995139aa tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1729 microversion: 2.1 time: 0.164106 Jun 16 15:00:54.186507 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 394/784] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:54 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:54.203076 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-80c4ebd3-1f2e-46ec-9a76-736146c9920d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:54.203581 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-80c4ebd3-1f2e-46ec-9a76-736146c9920d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:54.209923 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-80c4ebd3-1f2e-46ec-9a76-736146c9920d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:54.210404 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-80c4ebd3-1f2e-46ec-9a76-736146c9920d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:54.211250 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-80c4ebd3-1f2e-46ec-9a76-736146c9920d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:54.211703 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-80c4ebd3-1f2e-46ec-9a76-736146c9920d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:54.290039 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-80c4ebd3-1f2e-46ec-9a76-736146c9920d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091409 Jun 16 15:00:54.290639 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 391/785] 10.222.0.76 () {58 vars in 1274 bytes} [Thu Jun 16 15:00:54 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:54.323828 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-45cee8d6-b04a-4787-8f20-4a0d83f43f6d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:54.324803 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-45cee8d6-b04a-4787-8f20-4a0d83f43f6d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:54.331094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-45cee8d6-b04a-4787-8f20-4a0d83f43f6d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:54.331608 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-45cee8d6-b04a-4787-8f20-4a0d83f43f6d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:54.332440 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-45cee8d6-b04a-4787-8f20-4a0d83f43f6d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:54.332875 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-45cee8d6-b04a-4787-8f20-4a0d83f43f6d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:54.362881 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-45cee8d6-b04a-4787-8f20-4a0d83f43f6d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043437 Jun 16 15:00:54.363671 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 395/786] 10.222.0.76 () {60 vars in 1342 bytes} [Thu Jun 16 15:00:54 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 15:00:55.230114 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-a37434c7-c494-4707-afd2-491a32ff734b req-90398cc2-ab5b-4f48-886d-5a62b8559b57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b469ddcc-e9b1-4c39-9c75-3b98f6f624c3", "tag": "4ac5eb81-f7f2-453f-a4f4-fba5e3e3d8d9"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:55.240366 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-a37434c7-c494-4707-afd2-491a32ff734b req-90398cc2-ab5b-4f48-886d-5a62b8559b57 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:55.240742 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-a37434c7-c494-4707-afd2-491a32ff734b req-90398cc2-ab5b-4f48-886d-5a62b8559b57 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:55.255954 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-a37434c7-c494-4707-afd2-491a32ff734b req-90398cc2-ab5b-4f48-886d-5a62b8559b57 service nova] Creating event network-changed:4ac5eb81-f7f2-453f-a4f4-fba5e3e3d8d9 for instance b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 on hv-cinder-83716 Jun 16 15:00:55.262582 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-a37434c7-c494-4707-afd2-491a32ff734b req-90398cc2-ab5b-4f48-886d-5a62b8559b57 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036634 Jun 16 15:00:55.263178 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 392/787] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:55.377152 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3bef811b-b92e-4b56-bbc8-da0e5082aaad tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:55.379165 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3bef811b-b92e-4b56-bbc8-da0e5082aaad tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:55.386451 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3bef811b-b92e-4b56-bbc8-da0e5082aaad tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:55.386907 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3bef811b-b92e-4b56-bbc8-da0e5082aaad tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:55.387710 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3bef811b-b92e-4b56-bbc8-da0e5082aaad tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:55.388169 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3bef811b-b92e-4b56-bbc8-da0e5082aaad tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:55.419923 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3bef811b-b92e-4b56-bbc8-da0e5082aaad tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048590 Jun 16 15:00:55.421320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 396/788] 10.222.0.76 () {60 vars in 1342 bytes} [Thu Jun 16 15:00:55 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:55.486016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1f8e1acd-3510-4c1e-a9af-c4684b3c7d39 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:55.486682 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-1f8e1acd-3510-4c1e-a9af-c4684b3c7d39 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:55.492996 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1f8e1acd-3510-4c1e-a9af-c4684b3c7d39 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:55.493452 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1f8e1acd-3510-4c1e-a9af-c4684b3c7d39 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:55.494222 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1f8e1acd-3510-4c1e-a9af-c4684b3c7d39 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:55.494662 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1f8e1acd-3510-4c1e-a9af-c4684b3c7d39 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:55.523609 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-1f8e1acd-3510-4c1e-a9af-c4684b3c7d39 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Going to try to terminate instance {{(pid=117443) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:00:55.617240 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1f8e1acd-3510-4c1e-a9af-c4684b3c7d39 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "DELETE /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 204 len: 0 microversion: 2.20 time: 0.134927 Jun 16 15:00:55.617891 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 393/789] 10.222.0.76 () {60 vars in 1279 bytes} [Thu Jun 16 15:00:55 2022] DELETE /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 15:00:55.627090 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-07f156a9-2ea4-4b14-bd14-98e81e664209 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:55.627748 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-07f156a9-2ea4-4b14-bd14-98e81e664209 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:55.634514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-07f156a9-2ea4-4b14-bd14-98e81e664209 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:55.635257 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-07f156a9-2ea4-4b14-bd14-98e81e664209 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:55.638762 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-07f156a9-2ea4-4b14-bd14-98e81e664209 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:55.639404 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-07f156a9-2ea4-4b14-bd14-98e81e664209 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:55.782530 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-07f156a9-2ea4-4b14-bd14-98e81e664209 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:55.791105 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-07f156a9-2ea4-4b14-bd14-98e81e664209 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:55.792648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-07f156a9-2ea4-4b14-bd14-98e81e664209 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:55.793822 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-07f156a9-2ea4-4b14-bd14-98e81e664209 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 0.171375 Jun 16 15:00:55.794437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 397/790] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:00:55 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:00:56.812940 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a52ed62d-b293-40a4-b35e-c8f56b964b10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:56.813625 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a52ed62d-b293-40a4-b35e-c8f56b964b10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:56.820089 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a52ed62d-b293-40a4-b35e-c8f56b964b10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:56.820529 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a52ed62d-b293-40a4-b35e-c8f56b964b10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:56.821272 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a52ed62d-b293-40a4-b35e-c8f56b964b10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:56.821696 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a52ed62d-b293-40a4-b35e-c8f56b964b10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:56.952686 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a52ed62d-b293-40a4-b35e-c8f56b964b10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:56.960868 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a52ed62d-b293-40a4-b35e-c8f56b964b10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:56.962367 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a52ed62d-b293-40a4-b35e-c8f56b964b10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:56.963519 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a52ed62d-b293-40a4-b35e-c8f56b964b10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 0.154907 Jun 16 15:00:56.964115 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 394/791] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:00:56 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:00:57.277985 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-e38a91b4-25d0-4b89-a334-f72e6c1f9290 req-1dedba81-9c97-4431-ae84-09df3e3e2157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b469ddcc-e9b1-4c39-9c75-3b98f6f624c3", "tag": "4ac5eb81-f7f2-453f-a4f4-fba5e3e3d8d9"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:57.281906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=54 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:57.288068 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-e38a91b4-25d0-4b89-a334-f72e6c1f9290 req-1dedba81-9c97-4431-ae84-09df3e3e2157 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:57.288513 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-e38a91b4-25d0-4b89-a334-f72e6c1f9290 req-1dedba81-9c97-4431-ae84-09df3e3e2157 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:57.301380 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-e38a91b4-25d0-4b89-a334-f72e6c1f9290 req-1dedba81-9c97-4431-ae84-09df3e3e2157 service nova] Creating event network-changed:4ac5eb81-f7f2-453f-a4f4-fba5e3e3d8d9 for instance b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 on hv-cinder-83716 Jun 16 15:00:57.306210 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-e38a91b4-25d0-4b89-a334-f72e6c1f9290 req-1dedba81-9c97-4431-ae84-09df3e3e2157 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032538 Jun 16 15:00:57.306794 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 398/792] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:57.983582 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-93f3e49e-b1ad-47fb-800c-f31ab0606ae9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:57.984214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-93f3e49e-b1ad-47fb-800c-f31ab0606ae9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:57.991453 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-93f3e49e-b1ad-47fb-800c-f31ab0606ae9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:57.992009 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-93f3e49e-b1ad-47fb-800c-f31ab0606ae9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:57.992780 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-93f3e49e-b1ad-47fb-800c-f31ab0606ae9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:57.993205 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-93f3e49e-b1ad-47fb-800c-f31ab0606ae9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:58.486229 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-93f3e49e-b1ad-47fb-800c-f31ab0606ae9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:58.494668 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-93f3e49e-b1ad-47fb-800c-f31ab0606ae9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:58.496898 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-93f3e49e-b1ad-47fb-800c-f31ab0606ae9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:58.498076 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-93f3e49e-b1ad-47fb-800c-f31ab0606ae9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1724 microversion: 2.20 time: 0.518922 Jun 16 15:00:58.498850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 395/793] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:00:57 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1724 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:00:58.953007 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-abebea75-dc68-4d2f-958c-c1f6f45ea352 req-2ff94bb6-3dee-4d45-8fb6-dba8edd0c558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663488be-459f-4a58-aa1c-82be04813a2f", "name": "network-vif-deleted", "tag": "5508bdf2-993b-44f0-8926-4159b1e31b1d"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:58.972490 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-abebea75-dc68-4d2f-958c-c1f6f45ea352 req-2ff94bb6-3dee-4d45-8fb6-dba8edd0c558 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:58.973703 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-abebea75-dc68-4d2f-958c-c1f6f45ea352 req-2ff94bb6-3dee-4d45-8fb6-dba8edd0c558 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:58.994384 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-abebea75-dc68-4d2f-958c-c1f6f45ea352 req-2ff94bb6-3dee-4d45-8fb6-dba8edd0c558 service nova] Creating event network-vif-deleted:5508bdf2-993b-44f0-8926-4159b1e31b1d for instance 663488be-459f-4a58-aa1c-82be04813a2f on hv-cinder-83716 Jun 16 15:00:59.000922 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-abebea75-dc68-4d2f-958c-c1f6f45ea352 req-2ff94bb6-3dee-4d45-8fb6-dba8edd0c558 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060585 Jun 16 15:00:59.001569 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 399/794] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:59.517602 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a166a3ab-c621-4cd1-b80d-cc680309cca9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:59.518207 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a166a3ab-c621-4cd1-b80d-cc680309cca9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:59.525025 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a166a3ab-c621-4cd1-b80d-cc680309cca9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:59.525458 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a166a3ab-c621-4cd1-b80d-cc680309cca9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:59.527092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a166a3ab-c621-4cd1-b80d-cc680309cca9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:59.527557 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a166a3ab-c621-4cd1-b80d-cc680309cca9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:59.564517 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a166a3ab-c621-4cd1-b80d-cc680309cca9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:59.564961 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a166a3ab-c621-4cd1-b80d-cc680309cca9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:59.565414 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.objects.instance [None req-a166a3ab-c621-4cd1-b80d-cc680309cca9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lazy-loading 'fault' on Instance uuid 663488be-459f-4a58-aa1c-82be04813a2f {{(pid=117443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:00:59.568600 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:59.614345 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a166a3ab-c621-4cd1-b80d-cc680309cca9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:59.625356 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a166a3ab-c621-4cd1-b80d-cc680309cca9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:59.627641 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a166a3ab-c621-4cd1-b80d-cc680309cca9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:59.629121 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a166a3ab-c621-4cd1-b80d-cc680309cca9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 200 len: 1372 microversion: 2.20 time: 0.116084 Jun 16 15:00:59.630615 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 396/795] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:00:59 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 1372 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:00.649850 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f6891467-e41c-4f47-8533-40e4419ac884 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:00.650537 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f6891467-e41c-4f47-8533-40e4419ac884 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:00.658905 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f6891467-e41c-4f47-8533-40e4419ac884 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:00.659348 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f6891467-e41c-4f47-8533-40e4419ac884 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:00.660316 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f6891467-e41c-4f47-8533-40e4419ac884 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:00.660748 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f6891467-e41c-4f47-8533-40e4419ac884 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:00.678321 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-f6891467-e41c-4f47-8533-40e4419ac884 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] HTTP exception thrown: Instance 663488be-459f-4a58-aa1c-82be04813a2f could not be found. Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f6891467-e41c-4f47-8533-40e4419ac884 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Request method failure captured: Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f HTTP/1.1 Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0R2SaucNKuBEMsqpUPtCvjPUACFEzNeGRC5YUG4uCtrcNNfE-c8xrbSIIcW4b4_202tmbvL4nbAZntLL6MXwc-Z_QzVhpmWmEbmNd1N5Rxjm5z5fgbZAVHR2tdXP2kBpyMlLMHxYY-s_Sv1p-FB9b3r73viHEW5wEt1W-3iDP8gcR4 Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 2893d1739fb84d7c8a2311ef4aab72e5 Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-222833261 Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:01:00.680017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:01:00.681605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:01:00.681605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeShelveTestJSON-222833261 Jun 16 15:01:00.681605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 2893d1739fb84d7c8a2311ef4aab72e5 Jun 16 15:01:00.681605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-222833261 Jun 16 15:01:00.681605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeShelveTestJSON-222833261-project Jun 16 15:01:00.681605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:01:00.681605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:01:00.681605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 7c31b2060e83410482ac2bef20b0556e Jun 16 15:01:00.681605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeShelveTestJSON-222833261-project Jun 16 15:01:00.681605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:01:00.681605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance 663488be-459f-4a58-aa1c-82be04813a2f could not be found. Jun 16 15:01:00.681605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': '663488be-459f-4a58-aa1c-82be04813a2f'} Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 663488be-459f-4a58-aa1c-82be04813a2f could not be found. Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:01:00.682435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:01:00.683673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:01:00.683673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:01:00.683673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:01:00.683673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:01:00.683673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:01:00.683673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:01:00.683673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:01:00.683673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 663488be-459f-4a58-aa1c-82be04813a2f could not be found. Jun 16 15:01:00.683673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:00.683673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:01:00.683673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:00.683673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:00.683673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:01:00.683673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:01:00.683673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:01:00.683673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:01:00.683673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 663488be-459f-4a58-aa1c-82be04813a2f could not be found. Jun 16 15:01:00.683673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:00.684796 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f6891467-e41c-4f47-8533-40e4419ac884 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Returning 404 to user: Instance 663488be-459f-4a58-aa1c-82be04813a2f could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:01:00.684796 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f6891467-e41c-4f47-8533-40e4419ac884 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 404 len: 111 microversion: 2.20 time: 0.036299 Jun 16 15:01:00.684796 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 400/796] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:00 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 15:01:00.690515 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-9a6c68d7-ecfa-4bdd-a5a8-69bb4d8a03fe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '.version_select at 0x7f33e1275a60>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:00.710528 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-9a6c68d7-ecfa-4bdd-a5a8-69bb4d8a03fe tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1775340934" status: 204 len: 0 microversion: 2.20 time: 0.023443 Jun 16 15:01:00.711513 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 397/797] 10.222.0.76 () {60 vars in 1261 bytes} [Thu Jun 16 15:01:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1775340934 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 15:01:01.387723 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ea5e221e-9c96-4d56-a201-6d4be31803e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Action: 'create', calling method: .version_select at 0x7f33e132faf0>, body: {"keypair": {"name": "tempest-keypair-421875907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANxYo/D5Q5patn4yKZnb86BpO6ouPtU2W4+vF4aMuwdBqDN9GxowhUOGgiqltBwofZAxJyMv+NfQFEBSSIedi4td4TQNbjy1l2nL9lsq67b/JlY5mrlYleUXtI0hq5JCg=="}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:01.402631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-ea5e221e-9c96-4d56-a201-6d4be31803e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Getting quotas for project 2893d1739fb84d7c8a2311ef4aab72e5. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:01:01.406663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-ea5e221e-9c96-4d56-a201-6d4be31803e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Getting quotas for user 7c31b2060e83410482ac2bef20b0556e and project 2893d1739fb84d7c8a2311ef4aab72e5. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:01:01.429592 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ea5e221e-9c96-4d56-a201-6d4be31803e2 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046402 Jun 16 15:01:01.430185 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 401/798] 10.222.0.76 () {62 vars in 1199 bytes} [Thu Jun 16 15:01:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 16 15:01:02.798412 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d0dc88c2-339f-4cf4-b5ad-66cc0bef2c49 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-68529179", "imageRef": "f2f37ffa-db20-478d-84c0-b429a987933c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb632b7c-5874-4b1b-ab90-d925d1b84472"}], "security_groups": [{"name": "tempest-securitygroup--881518962"}], "key_name": "tempest-keypair-421875907", "user_data": "}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:02.906873 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.network.neutron [None req-d0dc88c2-339f-4cf4-b5ad-66cc0bef2c49 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] validate_networks() for [('bb632b7c-5874-4b1b-ab90-d925d1b84472', None, None, None, None, None)] {{(pid=117443) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:01:03.408035 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-d0dc88c2-339f-4cf4-b5ad-66cc0bef2c49 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Flavor limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:01:03.408603 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-d0dc88c2-339f-4cf4-b5ad-66cc0bef2c49 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Image limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:01:03.409253 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-d0dc88c2-339f-4cf4-b5ad-66cc0bef2c49 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Flavor pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:01:03.409665 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-d0dc88c2-339f-4cf4-b5ad-66cc0bef2c49 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Image pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:01:03.410104 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-d0dc88c2-339f-4cf4-b5ad-66cc0bef2c49 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:01:03.419241 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d0dc88c2-339f-4cf4-b5ad-66cc0bef2c49 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:03.419782 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d0dc88c2-339f-4cf4-b5ad-66cc0bef2c49 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:03.420580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d0dc88c2-339f-4cf4-b5ad-66cc0bef2c49 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:03.421009 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d0dc88c2-339f-4cf4-b5ad-66cc0bef2c49 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:03.444896 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-d0dc88c2-339f-4cf4-b5ad-66cc0bef2c49 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Getting quotas for project 2893d1739fb84d7c8a2311ef4aab72e5. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:01:03.454149 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-d0dc88c2-339f-4cf4-b5ad-66cc0bef2c49 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Getting quotas for user 7c31b2060e83410482ac2bef20b0556e and project 2893d1739fb84d7c8a2311ef4aab72e5. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:01:03.477293 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d0dc88c2-339f-4cf4-b5ad-66cc0bef2c49 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Going to run 1 instances... {{(pid=117443) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:01:03.481467 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d0dc88c2-339f-4cf4-b5ad-66cc0bef2c49 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2f37ffa-db20-478d-84c0-b429a987933c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:01:03.567136 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d0dc88c2-339f-4cf4-b5ad-66cc0bef2c49 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.773690 Jun 16 15:01:03.567833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 398/799] 10.222.0.76 () {62 vars in 1187 bytes} [Thu Jun 16 15:01:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 15:01:03.588742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-358835f3-32c1-4bb9-8d8c-7e449dc9f5b7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:03.590437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-358835f3-32c1-4bb9-8d8c-7e449dc9f5b7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:03.652844 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-358835f3-32c1-4bb9-8d8c-7e449dc9f5b7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:03.667277 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-358835f3-32c1-4bb9-8d8c-7e449dc9f5b7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:03.669075 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-358835f3-32c1-4bb9-8d8c-7e449dc9f5b7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:03.670492 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-358835f3-32c1-4bb9-8d8c-7e449dc9f5b7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1279 microversion: 2.20 time: 0.090796 Jun 16 15:01:03.671141 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 402/800] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:03 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:04.689205 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-62684085-a94b-4d5f-ba3b-d86ee48e1988 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:04.689809 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-62684085-a94b-4d5f-ba3b-d86ee48e1988 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:04.696668 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-62684085-a94b-4d5f-ba3b-d86ee48e1988 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:04.697115 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-62684085-a94b-4d5f-ba3b-d86ee48e1988 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:04.697874 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-62684085-a94b-4d5f-ba3b-d86ee48e1988 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:04.698304 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-62684085-a94b-4d5f-ba3b-d86ee48e1988 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:04.763039 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-62684085-a94b-4d5f-ba3b-d86ee48e1988 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:04.773212 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-62684085-a94b-4d5f-ba3b-d86ee48e1988 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:04.774727 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-62684085-a94b-4d5f-ba3b-d86ee48e1988 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:04.775917 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-62684085-a94b-4d5f-ba3b-d86ee48e1988 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1331 microversion: 2.20 time: 0.091703 Jun 16 15:01:04.777125 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 399/801] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:04 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:01:05.804096 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-51517ee3-4f2b-4ee3-8484-862b710862cc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:05.805414 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-51517ee3-4f2b-4ee3-8484-862b710862cc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:05.813133 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-51517ee3-4f2b-4ee3-8484-862b710862cc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:05.813584 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-51517ee3-4f2b-4ee3-8484-862b710862cc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:05.814362 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-51517ee3-4f2b-4ee3-8484-862b710862cc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:05.814798 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-51517ee3-4f2b-4ee3-8484-862b710862cc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:05.984852 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-51517ee3-4f2b-4ee3-8484-862b710862cc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:05.994143 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-51517ee3-4f2b-4ee3-8484-862b710862cc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:05.996674 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-51517ee3-4f2b-4ee3-8484-862b710862cc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:05.997796 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-51517ee3-4f2b-4ee3-8484-862b710862cc tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1404 microversion: 2.20 time: 0.197853 Jun 16 15:01:05.998350 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 403/802] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:05 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1404 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:06.530488 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-81da5509-7cee-4a15-95c7-2eb056cc09a9 req-3e6f0741-5db7-4c6c-bd03-0ca82b8514f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c044f7d0-a298-4c42-9a40-2bc494b1cdc9", "tag": "ee7ef7f3-bf69-418d-ace6-a422233a0197"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:06.548336 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-81da5509-7cee-4a15-95c7-2eb056cc09a9 req-3e6f0741-5db7-4c6c-bd03-0ca82b8514f3 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:06.548781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-81da5509-7cee-4a15-95c7-2eb056cc09a9 req-3e6f0741-5db7-4c6c-bd03-0ca82b8514f3 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:06.562653 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-81da5509-7cee-4a15-95c7-2eb056cc09a9 req-3e6f0741-5db7-4c6c-bd03-0ca82b8514f3 service nova] Creating event network-changed:ee7ef7f3-bf69-418d-ace6-a422233a0197 for instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 on hv-cinder-83716 Jun 16 15:01:06.569280 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-81da5509-7cee-4a15-95c7-2eb056cc09a9 req-3e6f0741-5db7-4c6c-bd03-0ca82b8514f3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042509 Jun 16 15:01:06.570597 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 400/803] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:07.016878 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4bc93fc5-5cf8-4c62-aeee-dd36cfb0e492 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:07.017608 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4bc93fc5-5cf8-4c62-aeee-dd36cfb0e492 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:07.025006 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4bc93fc5-5cf8-4c62-aeee-dd36cfb0e492 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:07.025459 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4bc93fc5-5cf8-4c62-aeee-dd36cfb0e492 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:07.026835 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4bc93fc5-5cf8-4c62-aeee-dd36cfb0e492 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:07.027403 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4bc93fc5-5cf8-4c62-aeee-dd36cfb0e492 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:07.178078 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4bc93fc5-5cf8-4c62-aeee-dd36cfb0e492 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:07.187072 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4bc93fc5-5cf8-4c62-aeee-dd36cfb0e492 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:07.188605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4bc93fc5-5cf8-4c62-aeee-dd36cfb0e492 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:07.189713 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4bc93fc5-5cf8-4c62-aeee-dd36cfb0e492 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1404 microversion: 2.20 time: 0.176959 Jun 16 15:01:07.190281 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 404/804] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:07 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1404 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:08.208611 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e05ce83b-2de8-47f0-836d-abcc77696f24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:08.209417 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e05ce83b-2de8-47f0-836d-abcc77696f24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:08.216918 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e05ce83b-2de8-47f0-836d-abcc77696f24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:08.217364 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e05ce83b-2de8-47f0-836d-abcc77696f24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:08.218136 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e05ce83b-2de8-47f0-836d-abcc77696f24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:08.218569 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e05ce83b-2de8-47f0-836d-abcc77696f24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:08.367057 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e05ce83b-2de8-47f0-836d-abcc77696f24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:08.377170 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e05ce83b-2de8-47f0-836d-abcc77696f24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:08.379277 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e05ce83b-2de8-47f0-836d-abcc77696f24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:08.380826 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e05ce83b-2de8-47f0-836d-abcc77696f24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1404 microversion: 2.20 time: 0.176529 Jun 16 15:01:08.381400 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 401/805] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:08 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1404 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:09.399827 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ba1e6873-4e34-430a-b086-3bf8e82bc3c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:09.400434 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ba1e6873-4e34-430a-b086-3bf8e82bc3c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:09.410639 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ba1e6873-4e34-430a-b086-3bf8e82bc3c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:09.411242 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ba1e6873-4e34-430a-b086-3bf8e82bc3c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:09.412081 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ba1e6873-4e34-430a-b086-3bf8e82bc3c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:09.412522 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ba1e6873-4e34-430a-b086-3bf8e82bc3c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:09.561271 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ba1e6873-4e34-430a-b086-3bf8e82bc3c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:09.571696 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ba1e6873-4e34-430a-b086-3bf8e82bc3c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:09.573206 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ba1e6873-4e34-430a-b086-3bf8e82bc3c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:09.574310 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ba1e6873-4e34-430a-b086-3bf8e82bc3c0 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1404 microversion: 2.20 time: 0.178554 Jun 16 15:01:09.574862 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 405/806] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:09 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1404 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:10.592396 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e6cc876b-fe2d-470b-96e5-beae678dd3aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:10.592935 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e6cc876b-fe2d-470b-96e5-beae678dd3aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:10.599831 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e6cc876b-fe2d-470b-96e5-beae678dd3aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:10.600292 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e6cc876b-fe2d-470b-96e5-beae678dd3aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:10.601060 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e6cc876b-fe2d-470b-96e5-beae678dd3aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:10.601530 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e6cc876b-fe2d-470b-96e5-beae678dd3aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:10.741185 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e6cc876b-fe2d-470b-96e5-beae678dd3aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:10.751668 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e6cc876b-fe2d-470b-96e5-beae678dd3aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:10.753194 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e6cc876b-fe2d-470b-96e5-beae678dd3aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:10.754347 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e6cc876b-fe2d-470b-96e5-beae678dd3aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1404 microversion: 2.20 time: 0.165901 Jun 16 15:01:10.754903 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 402/807] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:10 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:01:11.772693 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-fef6eaff-2f9e-40d0-b796-e0266cd074aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:11.773289 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-fef6eaff-2f9e-40d0-b796-e0266cd074aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:11.780214 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fef6eaff-2f9e-40d0-b796-e0266cd074aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:11.780776 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fef6eaff-2f9e-40d0-b796-e0266cd074aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:11.781560 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fef6eaff-2f9e-40d0-b796-e0266cd074aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:11.781997 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fef6eaff-2f9e-40d0-b796-e0266cd074aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:11.939747 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fef6eaff-2f9e-40d0-b796-e0266cd074aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:11.948048 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fef6eaff-2f9e-40d0-b796-e0266cd074aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:11.949582 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fef6eaff-2f9e-40d0-b796-e0266cd074aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:11.950687 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-fef6eaff-2f9e-40d0-b796-e0266cd074aa tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1404 microversion: 2.20 time: 0.182066 Jun 16 15:01:11.951250 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 406/808] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:11 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1404 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:12.220770 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-ba5fcbdb-327e-4792-973c-69780f1388d2 req-2f22c9f9-676c-4e6a-adc6-c5be620f6939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c044f7d0-a298-4c42-9a40-2bc494b1cdc9", "name": "network-vif-plugged", "status": "completed", "tag": "ee7ef7f3-bf69-418d-ace6-a422233a0197"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:12.231899 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-ba5fcbdb-327e-4792-973c-69780f1388d2 req-2f22c9f9-676c-4e6a-adc6-c5be620f6939 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:12.232339 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-ba5fcbdb-327e-4792-973c-69780f1388d2 req-2f22c9f9-676c-4e6a-adc6-c5be620f6939 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:12.243867 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-ba5fcbdb-327e-4792-973c-69780f1388d2 req-2f22c9f9-676c-4e6a-adc6-c5be620f6939 service nova] Creating event network-vif-plugged:ee7ef7f3-bf69-418d-ace6-a422233a0197 for instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 on hv-cinder-83716 Jun 16 15:01:12.249195 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-ba5fcbdb-327e-4792-973c-69780f1388d2 req-2f22c9f9-676c-4e6a-adc6-c5be620f6939 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032195 Jun 16 15:01:12.249785 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 403/809] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:12.969961 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a5012f05-360b-4529-ae12-f7113bc6c445 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:12.970614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a5012f05-360b-4529-ae12-f7113bc6c445 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:12.977324 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a5012f05-360b-4529-ae12-f7113bc6c445 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:12.977778 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a5012f05-360b-4529-ae12-f7113bc6c445 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:12.978551 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a5012f05-360b-4529-ae12-f7113bc6c445 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:12.978984 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a5012f05-360b-4529-ae12-f7113bc6c445 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:13.120877 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a5012f05-360b-4529-ae12-f7113bc6c445 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:13.129149 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a5012f05-360b-4529-ae12-f7113bc6c445 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:13.130649 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a5012f05-360b-4529-ae12-f7113bc6c445 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:13.131765 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a5012f05-360b-4529-ae12-f7113bc6c445 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1404 microversion: 2.20 time: 0.165737 Jun 16 15:01:13.132313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 407/810] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:12 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:14.147940 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=2 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:14.148699 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=6 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:14.153454 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f905f70f-f149-40f3-a5bf-adf5ae065db4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:14.154140 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f905f70f-f149-40f3-a5bf-adf5ae065db4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:14.161678 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f905f70f-f149-40f3-a5bf-adf5ae065db4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:14.162119 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f905f70f-f149-40f3-a5bf-adf5ae065db4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:14.162915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f905f70f-f149-40f3-a5bf-adf5ae065db4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:14.163338 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f905f70f-f149-40f3-a5bf-adf5ae065db4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:14.303636 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f905f70f-f149-40f3-a5bf-adf5ae065db4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:14.314766 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f905f70f-f149-40f3-a5bf-adf5ae065db4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:14.316937 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f905f70f-f149-40f3-a5bf-adf5ae065db4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:14.319244 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f905f70f-f149-40f3-a5bf-adf5ae065db4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1404 microversion: 2.20 time: 0.172307 Jun 16 15:01:14.320071 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 404/811] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:14 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1404 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:15.338024 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-28cd3bff-663a-4f00-a107-30cbf13a496b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:15.338576 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-28cd3bff-663a-4f00-a107-30cbf13a496b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:15.340623 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=6 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:15.347186 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-28cd3bff-663a-4f00-a107-30cbf13a496b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:15.347629 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-28cd3bff-663a-4f00-a107-30cbf13a496b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:15.348497 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-28cd3bff-663a-4f00-a107-30cbf13a496b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:15.348926 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-28cd3bff-663a-4f00-a107-30cbf13a496b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:15.480899 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-28cd3bff-663a-4f00-a107-30cbf13a496b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:15.488832 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-28cd3bff-663a-4f00-a107-30cbf13a496b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:15.490322 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-28cd3bff-663a-4f00-a107-30cbf13a496b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:15.491473 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-28cd3bff-663a-4f00-a107-30cbf13a496b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1596 microversion: 2.20 time: 0.157522 Jun 16 15:01:15.492070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 408/812] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:15 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1596 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:15.509204 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-5da8f18b-5b4c-4017-a4d0-c828fafb6609 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:15.509742 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-5da8f18b-5b4c-4017-a4d0-c828fafb6609 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:15.517143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5da8f18b-5b4c-4017-a4d0-c828fafb6609 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:15.517582 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5da8f18b-5b4c-4017-a4d0-c828fafb6609 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:15.518333 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5da8f18b-5b4c-4017-a4d0-c828fafb6609 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:15.518753 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5da8f18b-5b4c-4017-a4d0-c828fafb6609 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:15.596379 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-5da8f18b-5b4c-4017-a4d0-c828fafb6609 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090985 Jun 16 15:01:15.596961 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 405/813] 10.222.0.76 () {60 vars in 1315 bytes} [Thu Jun 16 15:01:15 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 15:01:16.843370 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-286c3007-10cd-4bd8-ba10-07ca0702278a req-140a2c9b-5886-4fba-a75d-0c2c63c861b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c044f7d0-a298-4c42-9a40-2bc494b1cdc9", "tag": "ee7ef7f3-bf69-418d-ace6-a422233a0197"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:16.851493 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-286c3007-10cd-4bd8-ba10-07ca0702278a req-140a2c9b-5886-4fba-a75d-0c2c63c861b2 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:16.851966 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-286c3007-10cd-4bd8-ba10-07ca0702278a req-140a2c9b-5886-4fba-a75d-0c2c63c861b2 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:16.863022 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-286c3007-10cd-4bd8-ba10-07ca0702278a req-140a2c9b-5886-4fba-a75d-0c2c63c861b2 service nova] Creating event network-changed:ee7ef7f3-bf69-418d-ace6-a422233a0197 for instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 on hv-cinder-83716 Jun 16 15:01:16.868111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-286c3007-10cd-4bd8-ba10-07ca0702278a req-140a2c9b-5886-4fba-a75d-0c2c63c861b2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094898 Jun 16 15:01:16.868661 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 409/814] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:19.759803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-024e55aa-2aa5-40be-b974-5a50ad13d438 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:19.760321 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-024e55aa-2aa5-40be-b974-5a50ad13d438 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:19.766412 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-024e55aa-2aa5-40be-b974-5a50ad13d438 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:19.766852 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-024e55aa-2aa5-40be-b974-5a50ad13d438 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:19.767609 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-024e55aa-2aa5-40be-b974-5a50ad13d438 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:19.768096 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-024e55aa-2aa5-40be-b974-5a50ad13d438 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:19.793903 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-024e55aa-2aa5-40be-b974-5a50ad13d438 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57/ips" status: 200 len: 149 microversion: 2.1 time: 0.141016 Jun 16 15:01:19.794372 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 406/815] 10.222.0.76 () {58 vars in 1247 bytes} [Thu Jun 16 15:01:19 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57/ips => generated 149 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:21.142777 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f8911fa1-cbe6-4f2e-a773-57c85a891d35 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "320fe075-97a3-4e40-9332-45895cca3be9"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:21.143939 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f8911fa1-cbe6-4f2e-a773-57c85a891d35 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:21.150121 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f8911fa1-cbe6-4f2e-a773-57c85a891d35 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:21.150564 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f8911fa1-cbe6-4f2e-a773-57c85a891d35 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:21.151320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f8911fa1-cbe6-4f2e-a773-57c85a891d35 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:21.151767 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f8911fa1-cbe6-4f2e-a773-57c85a891d35 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:21.458605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f8911fa1-cbe6-4f2e-a773-57c85a891d35 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "POST /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320525 Jun 16 15:01:21.459208 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 410/816] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Jun 16 15:01:21 2022] POST /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:24.523177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a87e695c-d002-4603-bc0e-e89b3f9df1f4 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-749114091"}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:24.523793 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a87e695c-d002-4603-bc0e-e89b3f9df1f4 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:24.526160 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:24.533307 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a87e695c-d002-4603-bc0e-e89b3f9df1f4 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:24.533900 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a87e695c-d002-4603-bc0e-e89b3f9df1f4 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:24.534884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a87e695c-d002-4603-bc0e-e89b3f9df1f4 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:24.535489 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a87e695c-d002-4603-bc0e-e89b3f9df1f4 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:24.674470 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.network.security_group_api [None req-a87e695c-d002-4603-bc0e-e89b3f9df1f4 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Removing security group fdb2c090-e84b-4a86-828e-7fd1f9091c31 from port b069c8fa-e747-4081-a398-e94c5755297b Jun 16 15:01:25.041612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a87e695c-d002-4603-bc0e-e89b3f9df1f4 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "POST /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/action" status: 202 len: 0 microversion: 2.1 time: 0.522233 Jun 16 15:01:25.045265 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 407/817] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Jun 16 15:01:24 2022] POST /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:01:25.127452 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-2364f04d-7cad-4911-ab5e-c9dd4b41438a req-2cab0b22-814c-4803-9e5e-de1f07dc82d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "120f403f-a9e1-4359-9e3b-6d3a98a5c7af", "tag": "b069c8fa-e747-4081-a398-e94c5755297b"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:25.137945 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-2364f04d-7cad-4911-ab5e-c9dd4b41438a req-2cab0b22-814c-4803-9e5e-de1f07dc82d4 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:25.138398 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-2364f04d-7cad-4911-ab5e-c9dd4b41438a req-2cab0b22-814c-4803-9e5e-de1f07dc82d4 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:25.142936 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:25.162275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-2364f04d-7cad-4911-ab5e-c9dd4b41438a req-2cab0b22-814c-4803-9e5e-de1f07dc82d4 service nova] Creating event network-changed:b069c8fa-e747-4081-a398-e94c5755297b for instance 120f403f-a9e1-4359-9e3b-6d3a98a5c7af on hv-cinder-83716 Jun 16 15:01:25.171098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-2364f04d-7cad-4911-ab5e-c9dd4b41438a req-2cab0b22-814c-4803-9e5e-de1f07dc82d4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121712 Jun 16 15:01:25.172025 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 411/818] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:26.196767 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-0b93fb13-832f-4258-bd80-92b6656596c6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:26.197279 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-0b93fb13-832f-4258-bd80-92b6656596c6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:26.203285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0b93fb13-832f-4258-bd80-92b6656596c6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:26.204129 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0b93fb13-832f-4258-bd80-92b6656596c6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:26.204890 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0b93fb13-832f-4258-bd80-92b6656596c6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:26.205322 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0b93fb13-832f-4258-bd80-92b6656596c6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:26.291273 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.objects.instance [None req-0b93fb13-832f-4258-bd80-92b6656596c6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lazy-loading 'services' on Instance uuid 120f403f-a9e1-4359-9e3b-6d3a98a5c7af {{(pid=117443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:01:26.366527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-0b93fb13-832f-4258-bd80-92b6656596c6 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "DELETE /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/os-volume_attachments/bb17dbbc-97ae-45d6-9230-392115091e69" status: 202 len: 0 microversion: 2.1 time: 0.174159 Jun 16 15:01:26.367396 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 408/819] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Jun 16 15:01:26 2022] DELETE /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/os-volume_attachments/bb17dbbc-97ae-45d6-9230-392115091e69 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:01:26.382418 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f1386379-6a1d-48f2-87fa-55a100a404c9 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:26.384226 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f1386379-6a1d-48f2-87fa-55a100a404c9 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:26.394133 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f1386379-6a1d-48f2-87fa-55a100a404c9 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:26.394757 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f1386379-6a1d-48f2-87fa-55a100a404c9 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:26.395623 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f1386379-6a1d-48f2-87fa-55a100a404c9 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:26.396154 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f1386379-6a1d-48f2-87fa-55a100a404c9 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:26.432963 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f1386379-6a1d-48f2-87fa-55a100a404c9 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055214 Jun 16 15:01:26.434173 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 412/820] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:01:26 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:27.186586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-33ec936f-bf84-40d1-90a1-3535bf4e0701 req-3820052b-da07-41ad-8bf9-67285f4dc102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "120f403f-a9e1-4359-9e3b-6d3a98a5c7af", "tag": "b069c8fa-e747-4081-a398-e94c5755297b"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:27.195878 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-33ec936f-bf84-40d1-90a1-3535bf4e0701 req-3820052b-da07-41ad-8bf9-67285f4dc102 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:27.196222 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-33ec936f-bf84-40d1-90a1-3535bf4e0701 req-3820052b-da07-41ad-8bf9-67285f4dc102 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:27.207902 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-33ec936f-bf84-40d1-90a1-3535bf4e0701 req-3820052b-da07-41ad-8bf9-67285f4dc102 service nova] Creating event network-changed:b069c8fa-e747-4081-a398-e94c5755297b for instance 120f403f-a9e1-4359-9e3b-6d3a98a5c7af on hv-cinder-83716 Jun 16 15:01:27.212952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-33ec936f-bf84-40d1-90a1-3535bf4e0701 req-3820052b-da07-41ad-8bf9-67285f4dc102 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031689 Jun 16 15:01:27.213562 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 409/821] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:27.445429 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1334e388-eff1-4f1a-82b2-2869ad30a3e1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:27.446404 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1334e388-eff1-4f1a-82b2-2869ad30a3e1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:27.449434 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:27.454368 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1334e388-eff1-4f1a-82b2-2869ad30a3e1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:27.454818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1334e388-eff1-4f1a-82b2-2869ad30a3e1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:27.455669 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1334e388-eff1-4f1a-82b2-2869ad30a3e1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:27.456115 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1334e388-eff1-4f1a-82b2-2869ad30a3e1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:27.486536 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1334e388-eff1-4f1a-82b2-2869ad30a3e1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045020 Jun 16 15:01:27.487125 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 413/822] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:01:27 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:28.500153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6d2cff1f-3418-4b9b-8d2f-808cd07e8630 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:28.501082 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6d2cff1f-3418-4b9b-8d2f-808cd07e8630 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:28.507943 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6d2cff1f-3418-4b9b-8d2f-808cd07e8630 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:28.508400 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6d2cff1f-3418-4b9b-8d2f-808cd07e8630 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:28.509160 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6d2cff1f-3418-4b9b-8d2f-808cd07e8630 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:28.509593 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6d2cff1f-3418-4b9b-8d2f-808cd07e8630 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:28.540378 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6d2cff1f-3418-4b9b-8d2f-808cd07e8630 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044560 Jun 16 15:01:28.540942 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 410/823] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:01:28 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:28.971962 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-828fae91-5d30-4c6d-bc27-20841f4e98b3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "320fe075-97a3-4e40-9332-45895cca3be9"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:28.973135 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-828fae91-5d30-4c6d-bc27-20841f4e98b3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:28.979738 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-828fae91-5d30-4c6d-bc27-20841f4e98b3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:28.980198 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-828fae91-5d30-4c6d-bc27-20841f4e98b3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:28.980979 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-828fae91-5d30-4c6d-bc27-20841f4e98b3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:28.981501 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-828fae91-5d30-4c6d-bc27-20841f4e98b3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:29.064354 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-828fae91-5d30-4c6d-bc27-20841f4e98b3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] HTTP exception thrown: Invalid volume: volume 320fe075-97a3-4e40-9332-45895cca3be9 is already attached to instances: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-828fae91-5d30-4c6d-bc27-20841f4e98b3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Request method failure captured: Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: POST /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57/os-volume_attachments HTTP/1.1 Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 74 Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0RvgNnHERAvlrn1WvFUUcvodkCzzgEgc9uA3Ra8J3x-gaqNyXJgZlXW9Fu3DW2tOgMnX7C8vwaaaUd2R9Mf98qk7wOTE2lojDUYY_ofhKl3QsPjUp0j-B30CwpTfHwGiZa1GU9kj2dLQMYLnA0B8U66Nc60nNiPBn1l71iNpcPmPQ4 Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:01:29.066070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:01:29.067518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_60ade68614ac4730a35c9958123d06e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:01:29.067518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:01:29.067518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:01:29.067518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:01:29.067518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:01:29.067518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:01:29.067518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:01:29.067518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 87a6ec62b5414930bf36f69f072d7df6 Jun 16 15:01:29.067518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:01:29.067518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Jun 16 15:01:29.067518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {"volumeAttachment": {"volumeId": "320fe075-97a3-4e40-9332-45895cca3be9"}} Jun 16 15:01:29.067518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Invalid volume: volume 320fe075-97a3-4e40-9332-45895cca3be9 is already attached to instances: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'server_id': 'f4d7f1ee-c351-40d2-8751-bbb43c7e4a57', 'body': {'volumeAttachment': {'volumeId': '320fe075-97a3-4e40-9332-45895cca3be9'}}} Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 320fe075-97a3-4e40-9332-45895cca3be9 is already attached to instances: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:29.068333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 320fe075-97a3-4e40-9332-45895cca3be9 is already attached to instances: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:29.069804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:01:29.071070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:01:29.071070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:01:29.071070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:01:29.071070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 320fe075-97a3-4e40-9332-45895cca3be9 is already attached to instances: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 Jun 16 15:01:29.071070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:29.071070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-828fae91-5d30-4c6d-bc27-20841f4e98b3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Returning 400 to user: Invalid volume: volume 320fe075-97a3-4e40-9332-45895cca3be9 is already attached to instances: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:01:29.071070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-828fae91-5d30-4c6d-bc27-20841f4e98b3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "POST /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099643 Jun 16 15:01:29.071070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 414/824] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Jun 16 15:01:28 2022] POST /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 15:01:29.130455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-15822157-a64d-4df5-ade0-f5c38b006966 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:29.130939 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-15822157-a64d-4df5-ade0-f5c38b006966 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:29.136958 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-15822157-a64d-4df5-ade0-f5c38b006966 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:29.137401 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-15822157-a64d-4df5-ade0-f5c38b006966 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:29.138144 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-15822157-a64d-4df5-ade0-f5c38b006966 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:29.138572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-15822157-a64d-4df5-ade0-f5c38b006966 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:29.218461 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.objects.instance [None req-15822157-a64d-4df5-ade0-f5c38b006966 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lazy-loading 'services' on Instance uuid f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 {{(pid=117443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:01:29.294936 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-15822157-a64d-4df5-ade0-f5c38b006966 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57/os-volume_attachments/320fe075-97a3-4e40-9332-45895cca3be9" status: 202 len: 0 microversion: 2.1 time: 0.168155 Jun 16 15:01:29.295585 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 411/825] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Jun 16 15:01:29 2022] DELETE /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57/os-volume_attachments/320fe075-97a3-4e40-9332-45895cca3be9 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:01:29.304136 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4cbad97d-dcfb-4879-881a-e6c18c561ca4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:29.305064 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4cbad97d-dcfb-4879-881a-e6c18c561ca4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:29.312885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4cbad97d-dcfb-4879-881a-e6c18c561ca4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:29.313380 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4cbad97d-dcfb-4879-881a-e6c18c561ca4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:29.314156 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4cbad97d-dcfb-4879-881a-e6c18c561ca4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:29.315037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4cbad97d-dcfb-4879-881a-e6c18c561ca4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:29.357143 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4cbad97d-dcfb-4879-881a-e6c18c561ca4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056506 Jun 16 15:01:29.360708 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 415/826] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:01:29 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:29.552221 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7988ade3-ce35-43dc-a251-91dc7a3042ff tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:29.553295 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7988ade3-ce35-43dc-a251-91dc7a3042ff tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:29.559895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7988ade3-ce35-43dc-a251-91dc7a3042ff tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:29.560345 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7988ade3-ce35-43dc-a251-91dc7a3042ff tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:29.561128 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7988ade3-ce35-43dc-a251-91dc7a3042ff tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:29.561594 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7988ade3-ce35-43dc-a251-91dc7a3042ff tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:29.586538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:29.592088 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7988ade3-ce35-43dc-a251-91dc7a3042ff tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044629 Jun 16 15:01:29.592669 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 412/827] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:01:29 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:30.374239 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-360d31c3-fc83-4822-86d6-894563ae95a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:30.375162 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-360d31c3-fc83-4822-86d6-894563ae95a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:30.382045 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-360d31c3-fc83-4822-86d6-894563ae95a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:30.382495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-360d31c3-fc83-4822-86d6-894563ae95a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:30.383259 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-360d31c3-fc83-4822-86d6-894563ae95a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:30.383734 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-360d31c3-fc83-4822-86d6-894563ae95a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:30.413879 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-360d31c3-fc83-4822-86d6-894563ae95a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044990 Jun 16 15:01:30.414439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 416/828] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:01:30 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:30.604512 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-097d1ac0-24d7-402d-a812-3cebedb8db38 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:30.605947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-097d1ac0-24d7-402d-a812-3cebedb8db38 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:30.612785 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-097d1ac0-24d7-402d-a812-3cebedb8db38 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:30.613237 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-097d1ac0-24d7-402d-a812-3cebedb8db38 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:30.613996 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-097d1ac0-24d7-402d-a812-3cebedb8db38 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:30.614431 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-097d1ac0-24d7-402d-a812-3cebedb8db38 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:30.644265 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-097d1ac0-24d7-402d-a812-3cebedb8db38 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044148 Jun 16 15:01:30.644736 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 413/829] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:01:30 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 15:01:30.654733 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c56ced6c-0ac8-4828-b356-d424e9072109 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:30.655284 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c56ced6c-0ac8-4828-b356-d424e9072109 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:30.661671 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c56ced6c-0ac8-4828-b356-d424e9072109 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:30.662258 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c56ced6c-0ac8-4828-b356-d424e9072109 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:30.662942 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c56ced6c-0ac8-4828-b356-d424e9072109 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:30.663385 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c56ced6c-0ac8-4828-b356-d424e9072109 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:30.741129 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-c56ced6c-0ac8-4828-b356-d424e9072109 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] HTTP exception thrown: Instance 120f403f-a9e1-4359-9e3b-6d3a98a5c7af is not attached to volume bb17dbbc-97ae-45d6-9230-392115091e69 Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c56ced6c-0ac8-4828-b356-d424e9072109 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Request method failure captured: Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: DELETE /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/os-volume_attachments/bb17dbbc-97ae-45d6-9230-392115091e69 HTTP/1.1 Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0Tyxx4j7-Mm0OE3_ObM2-dyxsEGXzPD9XglIKj2oMGkENc34FifY5jry37zXQiF2mGlZTT-oP51aMA0vK93-qunoVOTSEUK8quP1P9bE333OH0WNfRWvkbDE1SiXX-VXaQ_BbxHU2pkvhSIyrgvBPbfNzKYdULQtQBEA7uZoIIktAg Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 1b370efdc42b4a998a42230123901514 Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-TestMinimumBasicScenario-1383943308 Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:01:30.748583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:01:30.750246 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1b370efdc42b4a998a42230123901514"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1b370efdc42b4a998a42230123901514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1b370efdc42b4a998a42230123901514"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1b370efdc42b4a998a42230123901514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:01:30.750246 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-TestMinimumBasicScenario-1383943308 Jun 16 15:01:30.750246 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 1b370efdc42b4a998a42230123901514 Jun 16 15:01:30.750246 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1383943308 Jun 16 15:01:30.750246 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-TestMinimumBasicScenario-1383943308-project Jun 16 15:01:30.750246 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:01:30.750246 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:01:30.750246 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 9315da2f7a47475dbc7f886127a8dad2 Jun 16 15:01:30.750246 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-TestMinimumBasicScenario-1383943308-project Jun 16 15:01:30.750246 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:01:30.750246 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance 120f403f-a9e1-4359-9e3b-6d3a98a5c7af is not attached to volume bb17dbbc-97ae-45d6-9230-392115091e69 Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'server_id': '120f403f-a9e1-4359-9e3b-6d3a98a5c7af', 'id': 'bb17dbbc-97ae-45d6-9230-392115091e69'} Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bb17dbbc-97ae-45d6-9230-392115091e69. Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:01:30.751219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:01:30.752442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:01:30.752442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 15:01:30.752442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 15:01:30.752442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 120f403f-a9e1-4359-9e3b-6d3a98a5c7af is not attached to volume bb17dbbc-97ae-45d6-9230-392115091e69 Jun 16 15:01:30.752442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:30.752442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:01:30.752442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:30.752442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:30.752442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:01:30.752442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:01:30.752442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:01:30.752442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:01:30.752442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 120f403f-a9e1-4359-9e3b-6d3a98a5c7af is not attached to volume bb17dbbc-97ae-45d6-9230-392115091e69 Jun 16 15:01:30.752442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:30.752442 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c56ced6c-0ac8-4828-b356-d424e9072109 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Returning 404 to user: Instance 120f403f-a9e1-4359-9e3b-6d3a98a5c7af is not attached to volume bb17dbbc-97ae-45d6-9230-392115091e69 {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:01:30.753633 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c56ced6c-0ac8-4828-b356-d424e9072109 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "DELETE /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/os-volume_attachments/bb17dbbc-97ae-45d6-9230-392115091e69" status: 404 len: 154 microversion: 2.1 time: 0.099462 Jun 16 15:01:30.753633 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 417/830] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Jun 16 15:01:30 2022] DELETE /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af/os-volume_attachments/bb17dbbc-97ae-45d6-9230-392115091e69 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:01:31.425757 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-87572044-3b16-4580-914e-d7dc052c6a37 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:31.426727 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-87572044-3b16-4580-914e-d7dc052c6a37 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:31.432759 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-87572044-3b16-4580-914e-d7dc052c6a37 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:31.433206 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-87572044-3b16-4580-914e-d7dc052c6a37 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:31.434006 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-87572044-3b16-4580-914e-d7dc052c6a37 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:31.434423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-87572044-3b16-4580-914e-d7dc052c6a37 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:31.465892 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-87572044-3b16-4580-914e-d7dc052c6a37 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044215 Jun 16 15:01:31.466459 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 414/831] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:01:31 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 15:01:31.526125 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7d4088ea-f056-475a-830b-e3c6882dddab tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:31.526850 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7d4088ea-f056-475a-830b-e3c6882dddab tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:31.534478 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7d4088ea-f056-475a-830b-e3c6882dddab tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:31.534932 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7d4088ea-f056-475a-830b-e3c6882dddab tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:31.535734 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7d4088ea-f056-475a-830b-e3c6882dddab tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:31.536175 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7d4088ea-f056-475a-830b-e3c6882dddab tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:31.563518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7d4088ea-f056-475a-830b-e3c6882dddab tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:01:31.662163 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7d4088ea-f056-475a-830b-e3c6882dddab tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 204 len: 0 microversion: 2.1 time: 0.141228 Jun 16 15:01:31.663169 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 418/832] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:01:31 2022] DELETE /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:01:31.674278 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4a0fe131-592b-4988-a1f2-35de418e49e8 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:31.674996 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4a0fe131-592b-4988-a1f2-35de418e49e8 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:31.681908 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4a0fe131-592b-4988-a1f2-35de418e49e8 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:31.682359 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4a0fe131-592b-4988-a1f2-35de418e49e8 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:31.683121 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4a0fe131-592b-4988-a1f2-35de418e49e8 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:31.683631 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4a0fe131-592b-4988-a1f2-35de418e49e8 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:31.815357 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4a0fe131-592b-4988-a1f2-35de418e49e8 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:31.823444 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4a0fe131-592b-4988-a1f2-35de418e49e8 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1680 microversion: 2.1 time: 0.155380 Jun 16 15:01:31.824054 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 415/833] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:31 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:31.884544 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b128db5e-5cf1-47ac-ba14-fc10cb10f46a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:31.885133 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b128db5e-5cf1-47ac-ba14-fc10cb10f46a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:31.891098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b128db5e-5cf1-47ac-ba14-fc10cb10f46a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:31.891553 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b128db5e-5cf1-47ac-ba14-fc10cb10f46a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:31.892365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b128db5e-5cf1-47ac-ba14-fc10cb10f46a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:31.892801 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b128db5e-5cf1-47ac-ba14-fc10cb10f46a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:31.918613 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b128db5e-5cf1-47ac-ba14-fc10cb10f46a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:01:31.992922 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b128db5e-5cf1-47ac-ba14-fc10cb10f46a tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "DELETE /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 204 len: 0 microversion: 2.1 time: 0.112434 Jun 16 15:01:31.993495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 419/834] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:01:31 2022] DELETE /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:01:32.002229 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-60239f51-aefa-47e8-92b2-464d0e8409f3 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:32.002855 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-60239f51-aefa-47e8-92b2-464d0e8409f3 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:32.008806 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-60239f51-aefa-47e8-92b2-464d0e8409f3 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:32.009269 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-60239f51-aefa-47e8-92b2-464d0e8409f3 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:32.010060 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-60239f51-aefa-47e8-92b2-464d0e8409f3 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:32.010462 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-60239f51-aefa-47e8-92b2-464d0e8409f3 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:32.171464 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-60239f51-aefa-47e8-92b2-464d0e8409f3 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:32.179598 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-60239f51-aefa-47e8-92b2-464d0e8409f3 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1554 microversion: 2.1 time: 0.181102 Jun 16 15:01:32.180223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 416/835] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:31 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:32.842031 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c0f3576a-ccd7-40f4-a5c2-2f41cdd07e85 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:32.842733 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c0f3576a-ccd7-40f4-a5c2-2f41cdd07e85 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:32.850767 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c0f3576a-ccd7-40f4-a5c2-2f41cdd07e85 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:32.851441 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c0f3576a-ccd7-40f4-a5c2-2f41cdd07e85 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:32.852590 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c0f3576a-ccd7-40f4-a5c2-2f41cdd07e85 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:32.853033 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c0f3576a-ccd7-40f4-a5c2-2f41cdd07e85 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:32.989491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c0f3576a-ccd7-40f4-a5c2-2f41cdd07e85 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:32.998228 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c0f3576a-ccd7-40f4-a5c2-2f41cdd07e85 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1680 microversion: 2.1 time: 0.160939 Jun 16 15:01:32.998792 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 420/836] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:32 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:33.198119 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6084782b-8df4-4f51-bc31-60899f765a55 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:33.198646 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6084782b-8df4-4f51-bc31-60899f765a55 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:33.206094 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6084782b-8df4-4f51-bc31-60899f765a55 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:33.206547 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6084782b-8df4-4f51-bc31-60899f765a55 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:33.207314 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6084782b-8df4-4f51-bc31-60899f765a55 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:33.207783 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6084782b-8df4-4f51-bc31-60899f765a55 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:33.344019 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6084782b-8df4-4f51-bc31-60899f765a55 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:33.351743 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6084782b-8df4-4f51-bc31-60899f765a55 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1554 microversion: 2.1 time: 0.157516 Jun 16 15:01:33.352328 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 417/837] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:33 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:34.015622 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1f19bb30-2ce1-49d4-888f-7ef6e5a721ff tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:34.016202 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1f19bb30-2ce1-49d4-888f-7ef6e5a721ff tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:34.024467 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1f19bb30-2ce1-49d4-888f-7ef6e5a721ff tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:34.025176 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1f19bb30-2ce1-49d4-888f-7ef6e5a721ff tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:34.026266 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1f19bb30-2ce1-49d4-888f-7ef6e5a721ff tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:34.026948 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1f19bb30-2ce1-49d4-888f-7ef6e5a721ff tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:34.183811 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1f19bb30-2ce1-49d4-888f-7ef6e5a721ff tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:34.191846 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1f19bb30-2ce1-49d4-888f-7ef6e5a721ff tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1680 microversion: 2.1 time: 0.180020 Jun 16 15:01:34.192432 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 421/838] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:34 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:34.368673 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-2322fe76-efbc-485e-a848-f87be9cf559c tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:34.369315 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-2322fe76-efbc-485e-a848-f87be9cf559c tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:34.376750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2322fe76-efbc-485e-a848-f87be9cf559c tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:34.377195 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2322fe76-efbc-485e-a848-f87be9cf559c tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:34.377961 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2322fe76-efbc-485e-a848-f87be9cf559c tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:34.378394 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2322fe76-efbc-485e-a848-f87be9cf559c tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:34.525378 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2322fe76-efbc-485e-a848-f87be9cf559c tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:34.534951 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-2322fe76-efbc-485e-a848-f87be9cf559c tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1554 microversion: 2.1 time: 0.169928 Jun 16 15:01:34.535794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 418/839] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:34 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:35.210841 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e7e5e1a4-b60b-417e-b5e2-2ee83ef365ec tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:35.211462 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e7e5e1a4-b60b-417e-b5e2-2ee83ef365ec tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:35.219204 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7e5e1a4-b60b-417e-b5e2-2ee83ef365ec tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:35.219650 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7e5e1a4-b60b-417e-b5e2-2ee83ef365ec tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:35.220465 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7e5e1a4-b60b-417e-b5e2-2ee83ef365ec tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:35.220904 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7e5e1a4-b60b-417e-b5e2-2ee83ef365ec tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:35.364711 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e7e5e1a4-b60b-417e-b5e2-2ee83ef365ec tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:35.372516 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e7e5e1a4-b60b-417e-b5e2-2ee83ef365ec tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1680 microversion: 2.1 time: 0.165998 Jun 16 15:01:35.373116 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 422/840] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:35 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:35.552271 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-bddbd111-bc5d-45fb-94a7-67b421292652 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:35.552873 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-bddbd111-bc5d-45fb-94a7-67b421292652 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:35.560203 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bddbd111-bc5d-45fb-94a7-67b421292652 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:35.560782 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bddbd111-bc5d-45fb-94a7-67b421292652 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:35.561752 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bddbd111-bc5d-45fb-94a7-67b421292652 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:35.562308 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bddbd111-bc5d-45fb-94a7-67b421292652 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:35.705426 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-bddbd111-bc5d-45fb-94a7-67b421292652 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:35.713891 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-bddbd111-bc5d-45fb-94a7-67b421292652 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1554 microversion: 2.1 time: 0.165546 Jun 16 15:01:35.714564 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 419/841] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:35 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:36.164157 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-696db881-11e9-43b1-9f60-f25ffeb90caf req-9d324b7e-bbfb-4720-a689-96e32cd7c65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "120f403f-a9e1-4359-9e3b-6d3a98a5c7af", "name": "network-vif-deleted", "tag": "b069c8fa-e747-4081-a398-e94c5755297b"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:36.178393 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-696db881-11e9-43b1-9f60-f25ffeb90caf req-9d324b7e-bbfb-4720-a689-96e32cd7c65b service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:36.179320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-696db881-11e9-43b1-9f60-f25ffeb90caf req-9d324b7e-bbfb-4720-a689-96e32cd7c65b service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:36.191262 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-696db881-11e9-43b1-9f60-f25ffeb90caf req-9d324b7e-bbfb-4720-a689-96e32cd7c65b service nova] Creating event network-vif-deleted:b069c8fa-e747-4081-a398-e94c5755297b for instance 120f403f-a9e1-4359-9e3b-6d3a98a5c7af on hv-cinder-83716 Jun 16 15:01:36.196382 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-696db881-11e9-43b1-9f60-f25ffeb90caf req-9d324b7e-bbfb-4720-a689-96e32cd7c65b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041908 Jun 16 15:01:36.196973 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 423/842] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:36.390402 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e8867494-2611-4a30-aea6-22968d4012a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:36.391041 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e8867494-2611-4a30-aea6-22968d4012a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:36.397710 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e8867494-2611-4a30-aea6-22968d4012a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:36.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e8867494-2611-4a30-aea6-22968d4012a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:36.398960 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e8867494-2611-4a30-aea6-22968d4012a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:36.399444 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e8867494-2611-4a30-aea6-22968d4012a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:36.466464 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e8867494-2611-4a30-aea6-22968d4012a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:36.474807 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e8867494-2611-4a30-aea6-22968d4012a7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 200 len: 1612 microversion: 2.1 time: 0.088279 Jun 16 15:01:36.475560 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 420/843] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:36 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 1612 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:36.549266 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-c3bd8a71-25f0-4622-b081-21c32198e0bb req-8b10879f-6024-4453-a50e-767d8e48ae6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d7f1ee-c351-40d2-8751-bbb43c7e4a57", "name": "network-vif-deleted", "tag": "f79eb32a-fc6a-4e9d-b58c-8d301cf85cf9"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:36.559178 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-c3bd8a71-25f0-4622-b081-21c32198e0bb req-8b10879f-6024-4453-a50e-767d8e48ae6f service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:36.559839 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-c3bd8a71-25f0-4622-b081-21c32198e0bb req-8b10879f-6024-4453-a50e-767d8e48ae6f service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:36.573118 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-c3bd8a71-25f0-4622-b081-21c32198e0bb req-8b10879f-6024-4453-a50e-767d8e48ae6f service nova] Creating event network-vif-deleted:f79eb32a-fc6a-4e9d-b58c-8d301cf85cf9 for instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 on hv-cinder-83716 Jun 16 15:01:36.579135 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-c3bd8a71-25f0-4622-b081-21c32198e0bb req-8b10879f-6024-4453-a50e-767d8e48ae6f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034810 Jun 16 15:01:36.579774 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 424/844] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:36.735362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f09b47cf-49b4-4f36-af9a-d878cb6045ba tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:36.737461 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f09b47cf-49b4-4f36-af9a-d878cb6045ba tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:36.749675 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f09b47cf-49b4-4f36-af9a-d878cb6045ba tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:36.750525 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f09b47cf-49b4-4f36-af9a-d878cb6045ba tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:36.751496 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f09b47cf-49b4-4f36-af9a-d878cb6045ba tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:36.752134 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f09b47cf-49b4-4f36-af9a-d878cb6045ba tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:36.788026 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f09b47cf-49b4-4f36-af9a-d878cb6045ba tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:36.788468 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f09b47cf-49b4-4f36-af9a-d878cb6045ba tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:36.788923 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.objects.instance [None req-f09b47cf-49b4-4f36-af9a-d878cb6045ba tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lazy-loading 'fault' on Instance uuid 120f403f-a9e1-4359-9e3b-6d3a98a5c7af {{(pid=117443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:01:36.831019 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f09b47cf-49b4-4f36-af9a-d878cb6045ba tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315da2f7a47475dbc7f886127a8dad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b370efdc42b4a998a42230123901514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:36.840235 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f09b47cf-49b4-4f36-af9a-d878cb6045ba tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 200 len: 1348 microversion: 2.1 time: 0.110929 Jun 16 15:01:36.841163 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 421/845] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:36 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 1348 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:37.493395 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5162e93e-45ae-4af6-a792-66c86e1a6827 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:37.494197 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5162e93e-45ae-4af6-a792-66c86e1a6827 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:37.500522 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5162e93e-45ae-4af6-a792-66c86e1a6827 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:37.501126 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5162e93e-45ae-4af6-a792-66c86e1a6827 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:37.501938 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5162e93e-45ae-4af6-a792-66c86e1a6827 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:37.502379 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5162e93e-45ae-4af6-a792-66c86e1a6827 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:37.516510 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-5162e93e-45ae-4af6-a792-66c86e1a6827 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] HTTP exception thrown: Instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 could not be found. Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5162e93e-45ae-4af6-a792-66c86e1a6827 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Request method failure captured: Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 HTTP/1.1 Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0RvgNnHERAvlrn1WvFUUcvodkCzzgEgc9uA3Ra8J3x-gaqNyXJgZlXW9Fu3DW2tOgMnX7C8vwaaaUd2R9Mf98qk7wOTE2lojDUYY_ofhKl3QsPjUp0j-B30CwpTfHwGiZa1GU9kj2dLQMYLnA0B8U66Nc60nNiPBn1l71iNpcPmPQ4 Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:01:37.518067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:01:37.519539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_60ade68614ac4730a35c9958123d06e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:01:37.519539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:01:37.519539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:01:37.519539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:01:37.519539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:01:37.519539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:01:37.519539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:01:37.519539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 87a6ec62b5414930bf36f69f072d7df6 Jun 16 15:01:37.519539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:01:37.519539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:01:37.519539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 could not be found. Jun 16 15:01:37.519539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': 'f4d7f1ee-c351-40d2-8751-bbb43c7e4a57'} Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 could not be found. Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:01:37.520495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:01:37.521742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:01:37.521742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:01:37.521742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:01:37.521742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:01:37.521742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:01:37.521742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:01:37.521742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:01:37.521742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 could not be found. Jun 16 15:01:37.521742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:37.521742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:01:37.521742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:37.521742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:37.521742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:01:37.521742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:01:37.521742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:01:37.521742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:01:37.521742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 could not be found. Jun 16 15:01:37.521742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:37.522868 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5162e93e-45ae-4af6-a792-66c86e1a6827 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Returning 404 to user: Instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:01:37.522868 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5162e93e-45ae-4af6-a792-66c86e1a6827 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 404 len: 111 microversion: 2.1 time: 0.030468 Jun 16 15:01:37.522868 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 425/846] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:37 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:01:37.532168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-0b29324e-bcbe-4d87-a0c2-b41a28e2d930 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '.version_select at 0x7f33e1252ee0>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:37.550668 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-0b29324e-bcbe-4d87-a0c2-b41a28e2d930 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-176369710" status: 202 len: 0 microversion: 2.1 time: 0.022217 Jun 16 15:01:37.551248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 422/847] 10.222.0.76 () {58 vars in 1217 bytes} [Thu Jun 16 15:01:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-176369710 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:01:37.860247 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-277523a9-699a-40d8-bfd7-ccf7a6cd29cd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:37.860863 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-277523a9-699a-40d8-bfd7-ccf7a6cd29cd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] [instance: 120f403f-a9e1-4359-9e3b-6d3a98a5c7af] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:37.867316 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-277523a9-699a-40d8-bfd7-ccf7a6cd29cd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:37.867799 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-277523a9-699a-40d8-bfd7-ccf7a6cd29cd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:37.868568 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-277523a9-699a-40d8-bfd7-ccf7a6cd29cd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:37.869005 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-277523a9-699a-40d8-bfd7-ccf7a6cd29cd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:37.882563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-277523a9-699a-40d8-bfd7-ccf7a6cd29cd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] HTTP exception thrown: Instance 120f403f-a9e1-4359-9e3b-6d3a98a5c7af could not be found. Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-277523a9-699a-40d8-bfd7-ccf7a6cd29cd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Request method failure captured: Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af HTTP/1.1 Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0Tyxx4j7-Mm0OE3_ObM2-dyxsEGXzPD9XglIKj2oMGkENc34FifY5jry37zXQiF2mGlZTT-oP51aMA0vK93-qunoVOTSEUK8quP1P9bE333OH0WNfRWvkbDE1SiXX-VXaQ_BbxHU2pkvhSIyrgvBPbfNzKYdULQtQBEA7uZoIIktAg Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 1b370efdc42b4a998a42230123901514 Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-TestMinimumBasicScenario-1383943308 Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:01:37.884147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:01:37.885683 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1b370efdc42b4a998a42230123901514"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1b370efdc42b4a998a42230123901514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1b370efdc42b4a998a42230123901514"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1b370efdc42b4a998a42230123901514"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:01:37.885683 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-TestMinimumBasicScenario-1383943308 Jun 16 15:01:37.885683 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 1b370efdc42b4a998a42230123901514 Jun 16 15:01:37.885683 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1383943308 Jun 16 15:01:37.885683 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-TestMinimumBasicScenario-1383943308-project Jun 16 15:01:37.885683 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:01:37.885683 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:01:37.885683 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 9315da2f7a47475dbc7f886127a8dad2 Jun 16 15:01:37.885683 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-TestMinimumBasicScenario-1383943308-project Jun 16 15:01:37.885683 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:01:37.885683 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance 120f403f-a9e1-4359-9e3b-6d3a98a5c7af could not be found. Jun 16 15:01:37.885683 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': '120f403f-a9e1-4359-9e3b-6d3a98a5c7af'} Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 120f403f-a9e1-4359-9e3b-6d3a98a5c7af could not be found. Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:01:37.886496 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:01:37.887648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:01:37.887648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:01:37.887648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:01:37.887648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:01:37.887648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:01:37.887648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:01:37.887648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:01:37.887648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 120f403f-a9e1-4359-9e3b-6d3a98a5c7af could not be found. Jun 16 15:01:37.887648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:37.887648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:01:37.887648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:37.887648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:37.887648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:01:37.887648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:01:37.887648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:01:37.887648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:01:37.887648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 120f403f-a9e1-4359-9e3b-6d3a98a5c7af could not be found. Jun 16 15:01:37.887648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:37.888750 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-277523a9-699a-40d8-bfd7-ccf7a6cd29cd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Returning 404 to user: Instance 120f403f-a9e1-4359-9e3b-6d3a98a5c7af could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:01:37.888750 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-277523a9-699a-40d8-bfd7-ccf7a6cd29cd tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af" status: 404 len: 111 microversion: 2.1 time: 0.031310 Jun 16 15:01:37.888750 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 426/848] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:37 2022] GET /compute/v2.1/servers/120f403f-a9e1-4359-9e3b-6d3a98a5c7af => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:01:37.895296 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8cd3a845-98b2-4eee-bd40-782d2bf689e1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] Calling method '.version_select at 0x7f33e1209670>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:37.913787 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8cd3a845-98b2-4eee-bd40-782d2bf689e1 tempest-TestMinimumBasicScenario-1383943308 tempest-TestMinimumBasicScenario-1383943308-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1123455784" status: 202 len: 0 microversion: 2.1 time: 0.023324 Jun 16 15:01:37.914604 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 423/849] 10.222.0.76 () {58 vars in 1271 bytes} [Thu Jun 16 15:01:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1123455784 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:01:38.201316 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-73724044-c755-472e-a5a9-6923aff51fb3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Action: 'create', calling method: .version_select at 0x7f33e1331280>, body: {"keypair": {"name": "tempest-keypair-1064478703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA250l3nxIuvHyw+gAHSlfDzwmvqmPEEqK6XSguphIQM8On93sQkTbnDAV+GIAhg0B5Qgks+8dtxPVgjbcBL82slGt/5vGA5NZccS/4nuNR/945xz9OMYR4A+C7HzJqKdg=="}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:38.216331 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-73724044-c755-472e-a5a9-6923aff51fb3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Getting quotas for project 60ade68614ac4730a35c9958123d06e8. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:01:38.220434 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-73724044-c755-472e-a5a9-6923aff51fb3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Getting quotas for user 87a6ec62b5414930bf36f69f072d7df6 and project 60ade68614ac4730a35c9958123d06e8. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:01:38.245569 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-73724044-c755-472e-a5a9-6923aff51fb3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048788 Jun 16 15:01:38.246193 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 427/850] 10.222.0.76 () {60 vars in 1158 bytes} [Thu Jun 16 15:01:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:39.950586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-df0da222-79c5-4183-b1e2-281cb5042b53 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1081575466", "imageRef": "f2f37ffa-db20-478d-84c0-b429a987933c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3e2520f-526d-4c84-9c0f-99f9be8b2582"}], "security_groups": [{"name": "tempest-securitygroup--268347652"}], "key_name": "tempest-keypair-1064478703", "user_data": "}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:40.070970 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.network.neutron [None req-df0da222-79c5-4183-b1e2-281cb5042b53 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] validate_networks() for [('f3e2520f-526d-4c84-9c0f-99f9be8b2582', None, None, None, None, None)] {{(pid=117443) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:01:40.729266 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-df0da222-79c5-4183-b1e2-281cb5042b53 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Flavor limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:01:40.729835 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-df0da222-79c5-4183-b1e2-281cb5042b53 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Image limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:01:40.731040 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-df0da222-79c5-4183-b1e2-281cb5042b53 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Flavor pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:01:40.731555 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-df0da222-79c5-4183-b1e2-281cb5042b53 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Image pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:01:40.732112 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-df0da222-79c5-4183-b1e2-281cb5042b53 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:01:40.742632 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-df0da222-79c5-4183-b1e2-281cb5042b53 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:40.743508 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-df0da222-79c5-4183-b1e2-281cb5042b53 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:40.744440 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-df0da222-79c5-4183-b1e2-281cb5042b53 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:40.744987 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-df0da222-79c5-4183-b1e2-281cb5042b53 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:40.763269 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-df0da222-79c5-4183-b1e2-281cb5042b53 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Getting quotas for project 60ade68614ac4730a35c9958123d06e8. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:01:40.767524 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-df0da222-79c5-4183-b1e2-281cb5042b53 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Getting quotas for user 87a6ec62b5414930bf36f69f072d7df6 and project 60ade68614ac4730a35c9958123d06e8. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:01:40.782074 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-df0da222-79c5-4183-b1e2-281cb5042b53 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Going to run 1 instances... {{(pid=117443) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:01:40.785633 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-df0da222-79c5-4183-b1e2-281cb5042b53 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2f37ffa-db20-478d-84c0-b429a987933c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:01:40.850523 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-df0da222-79c5-4183-b1e2-281cb5042b53 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.905095 Jun 16 15:01:40.851616 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 424/851] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 15:01:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 15:01:40.863119 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d802a2e3-9eba-4114-99ae-e54041acf58f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:40.863755 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d802a2e3-9eba-4114-99ae-e54041acf58f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:40.924324 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d802a2e3-9eba-4114-99ae-e54041acf58f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:40.932076 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d802a2e3-9eba-4114-99ae-e54041acf58f tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1242 microversion: 2.1 time: 0.073325 Jun 16 15:01:40.932836 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 428/852] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:40 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:41.956631 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-66fa395e-4877-4496-9c45-0dc5bb25fd2c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:41.957915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-66fa395e-4877-4496-9c45-0dc5bb25fd2c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:41.967841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-66fa395e-4877-4496-9c45-0dc5bb25fd2c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:41.968626 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-66fa395e-4877-4496-9c45-0dc5bb25fd2c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:41.969824 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-66fa395e-4877-4496-9c45-0dc5bb25fd2c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:41.970542 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-66fa395e-4877-4496-9c45-0dc5bb25fd2c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:42.074511 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-66fa395e-4877-4496-9c45-0dc5bb25fd2c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:42.086867 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-66fa395e-4877-4496-9c45-0dc5bb25fd2c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1294 microversion: 2.1 time: 0.136425 Jun 16 15:01:42.087869 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 425/853] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:41 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1294 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:42.808180 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-12a9054a-e2b8-495c-bb5d-ede069f14b82 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:42.809791 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-12a9054a-e2b8-495c-bb5d-ede069f14b82 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:42.818158 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-12a9054a-e2b8-495c-bb5d-ede069f14b82 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:42.818626 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-12a9054a-e2b8-495c-bb5d-ede069f14b82 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:42.819523 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-12a9054a-e2b8-495c-bb5d-ede069f14b82 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:42.820188 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-12a9054a-e2b8-495c-bb5d-ede069f14b82 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:42.908948 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:42.915559 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-12a9054a-e2b8-495c-bb5d-ede069f14b82 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lazy-loading 'services' on Instance uuid b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:01:43.002536 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-12a9054a-e2b8-495c-bb5d-ede069f14b82 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/os-volume_attachments/21283df4-965b-4d19-81f0-82c4f8df7c3e" status: 202 len: 0 microversion: 2.1 time: 0.197689 Jun 16 15:01:43.004002 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 429/854] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Jun 16 15:01:42 2022] DELETE /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/os-volume_attachments/21283df4-965b-4d19-81f0-82c4f8df7c3e => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:01:43.012793 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a5f1eac3-2f49-4777-8af4-6c78e5cc5ee6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:43.015305 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a5f1eac3-2f49-4777-8af4-6c78e5cc5ee6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:43.024079 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a5f1eac3-2f49-4777-8af4-6c78e5cc5ee6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:43.024791 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a5f1eac3-2f49-4777-8af4-6c78e5cc5ee6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:43.025841 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a5f1eac3-2f49-4777-8af4-6c78e5cc5ee6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:43.026487 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a5f1eac3-2f49-4777-8af4-6c78e5cc5ee6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:43.061430 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a5f1eac3-2f49-4777-8af4-6c78e5cc5ee6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053358 Jun 16 15:01:43.062641 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 426/855] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:01:43 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:43.112714 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-99fe8cae-761c-4007-903d-e62a508da189 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:43.113665 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-99fe8cae-761c-4007-903d-e62a508da189 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:43.121102 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-99fe8cae-761c-4007-903d-e62a508da189 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:43.121882 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-99fe8cae-761c-4007-903d-e62a508da189 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:43.122974 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-99fe8cae-761c-4007-903d-e62a508da189 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:43.123616 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-99fe8cae-761c-4007-903d-e62a508da189 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:43.204854 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-99fe8cae-761c-4007-903d-e62a508da189 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:43.212571 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-99fe8cae-761c-4007-903d-e62a508da189 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1300 microversion: 2.1 time: 0.105516 Jun 16 15:01:43.213710 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 430/856] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:43 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1300 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:44.073753 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-41e3258c-b571-49a9-a233-5021256b3cc5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:44.074674 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-41e3258c-b571-49a9-a233-5021256b3cc5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:44.081444 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-41e3258c-b571-49a9-a233-5021256b3cc5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:44.082626 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-41e3258c-b571-49a9-a233-5021256b3cc5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:44.083581 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-41e3258c-b571-49a9-a233-5021256b3cc5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:44.084258 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-41e3258c-b571-49a9-a233-5021256b3cc5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:44.123080 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-41e3258c-b571-49a9-a233-5021256b3cc5 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053244 Jun 16 15:01:44.124067 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 427/857] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:01:44 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 15:01:44.204777 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-111dea60-a871-48e8-b65d-34897a6a3c69 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:44.205425 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-111dea60-a871-48e8-b65d-34897a6a3c69 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:44.215141 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-111dea60-a871-48e8-b65d-34897a6a3c69 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:44.216389 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-111dea60-a871-48e8-b65d-34897a6a3c69 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:44.216788 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-111dea60-a871-48e8-b65d-34897a6a3c69 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:44.217507 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-111dea60-a871-48e8-b65d-34897a6a3c69 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:44.237863 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-91c7396d-6efa-4b08-b3a0-10afd969c154 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:44.240667 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-91c7396d-6efa-4b08-b3a0-10afd969c154 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:44.252355 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-111dea60-a871-48e8-b65d-34897a6a3c69 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:01:44.263006 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-91c7396d-6efa-4b08-b3a0-10afd969c154 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:44.264726 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-91c7396d-6efa-4b08-b3a0-10afd969c154 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:44.267796 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-91c7396d-6efa-4b08-b3a0-10afd969c154 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:44.268241 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-91c7396d-6efa-4b08-b3a0-10afd969c154 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:44.413068 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-111dea60-a871-48e8-b65d-34897a6a3c69 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "DELETE /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 204 len: 0 microversion: 2.1 time: 0.212016 Jun 16 15:01:44.414656 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 431/858] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:01:44 2022] DELETE /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:01:44.428856 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8ff99aeb-7bf1-4f96-90f8-a41770d0e332 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:44.430012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8ff99aeb-7bf1-4f96-90f8-a41770d0e332 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:44.440032 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8ff99aeb-7bf1-4f96-90f8-a41770d0e332 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:44.440766 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8ff99aeb-7bf1-4f96-90f8-a41770d0e332 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:44.442543 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8ff99aeb-7bf1-4f96-90f8-a41770d0e332 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:44.443093 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8ff99aeb-7bf1-4f96-90f8-a41770d0e332 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:44.469646 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-91c7396d-6efa-4b08-b3a0-10afd969c154 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:44.481626 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-91c7396d-6efa-4b08-b3a0-10afd969c154 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1367 microversion: 2.1 time: 0.253489 Jun 16 15:01:44.488973 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 428/859] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:44 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:44.616592 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8ff99aeb-7bf1-4f96-90f8-a41770d0e332 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:44.630044 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8ff99aeb-7bf1-4f96-90f8-a41770d0e332 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1689 microversion: 2.1 time: 0.207500 Jun 16 15:01:44.631143 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 432/860] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:44 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1689 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:44.645419 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-13eff440-54fe-4636-aff8-b23603f1025d req-90109564-6129-43f9-8cc8-08bd73dc1cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba216f58-575e-4ed9-a34c-1150c21bd527", "tag": "a89301a0-2f3e-4c5e-b399-8067e370078d"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:44.654855 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-13eff440-54fe-4636-aff8-b23603f1025d req-90109564-6129-43f9-8cc8-08bd73dc1cc4 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:44.655448 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-13eff440-54fe-4636-aff8-b23603f1025d req-90109564-6129-43f9-8cc8-08bd73dc1cc4 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:44.687388 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-13eff440-54fe-4636-aff8-b23603f1025d req-90109564-6129-43f9-8cc8-08bd73dc1cc4 service nova] Creating event network-changed:a89301a0-2f3e-4c5e-b399-8067e370078d for instance ba216f58-575e-4ed9-a34c-1150c21bd527 on hv-cinder-83716 Jun 16 15:01:44.695990 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-13eff440-54fe-4636-aff8-b23603f1025d req-90109564-6129-43f9-8cc8-08bd73dc1cc4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054918 Jun 16 15:01:44.697895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 429/861] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:45.498843 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9510a484-6260-4097-9462-ff89c8dd631b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:45.500477 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9510a484-6260-4097-9462-ff89c8dd631b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:45.506452 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9510a484-6260-4097-9462-ff89c8dd631b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:45.506896 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9510a484-6260-4097-9462-ff89c8dd631b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:45.507668 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9510a484-6260-4097-9462-ff89c8dd631b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:45.508139 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9510a484-6260-4097-9462-ff89c8dd631b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:45.649613 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-59e0ce19-3c30-4ebd-a427-3052b8d5177c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:45.650466 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-59e0ce19-3c30-4ebd-a427-3052b8d5177c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:45.658043 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-59e0ce19-3c30-4ebd-a427-3052b8d5177c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:45.658742 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-59e0ce19-3c30-4ebd-a427-3052b8d5177c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:45.659745 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-59e0ce19-3c30-4ebd-a427-3052b8d5177c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:45.660339 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-59e0ce19-3c30-4ebd-a427-3052b8d5177c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:45.796599 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9510a484-6260-4097-9462-ff89c8dd631b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:45.805088 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9510a484-6260-4097-9462-ff89c8dd631b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1367 microversion: 2.1 time: 0.310586 Jun 16 15:01:45.815932 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 433/862] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:45 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:45.942217 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-59e0ce19-3c30-4ebd-a427-3052b8d5177c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:45.951606 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-59e0ce19-3c30-4ebd-a427-3052b8d5177c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1689 microversion: 2.1 time: 0.307590 Jun 16 15:01:45.952316 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 430/863] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:45 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1689 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:46.824652 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7f4176e5-7030-487a-b2f4-2aba4156f5e0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:46.825729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7f4176e5-7030-487a-b2f4-2aba4156f5e0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:46.832396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7f4176e5-7030-487a-b2f4-2aba4156f5e0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:46.832837 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7f4176e5-7030-487a-b2f4-2aba4156f5e0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:46.833607 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7f4176e5-7030-487a-b2f4-2aba4156f5e0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:46.834038 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7f4176e5-7030-487a-b2f4-2aba4156f5e0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:46.968817 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a4ac813a-a05c-46f0-aba0-81c411bc205d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:46.969520 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a4ac813a-a05c-46f0-aba0-81c411bc205d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:46.976272 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a4ac813a-a05c-46f0-aba0-81c411bc205d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:46.976718 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a4ac813a-a05c-46f0-aba0-81c411bc205d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:46.977482 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a4ac813a-a05c-46f0-aba0-81c411bc205d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:46.977913 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a4ac813a-a05c-46f0-aba0-81c411bc205d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:47.020131 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7f4176e5-7030-487a-b2f4-2aba4156f5e0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:47.027666 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7f4176e5-7030-487a-b2f4-2aba4156f5e0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1367 microversion: 2.1 time: 0.207988 Jun 16 15:01:47.028262 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 434/864] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:46 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:47.151440 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a4ac813a-a05c-46f0-aba0-81c411bc205d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:47.160688 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a4ac813a-a05c-46f0-aba0-81c411bc205d tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1689 microversion: 2.1 time: 0.195325 Jun 16 15:01:47.161101 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 431/865] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:46 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1689 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:48.045143 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7671c00f-166f-41f6-b2a8-dc59dae7ac0b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:48.045757 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7671c00f-166f-41f6-b2a8-dc59dae7ac0b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:48.052371 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7671c00f-166f-41f6-b2a8-dc59dae7ac0b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:48.052820 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7671c00f-166f-41f6-b2a8-dc59dae7ac0b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:48.053577 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7671c00f-166f-41f6-b2a8-dc59dae7ac0b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:48.054010 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7671c00f-166f-41f6-b2a8-dc59dae7ac0b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:48.178474 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e52b33ed-b1cd-4023-8a98-3c7ac24cc5f6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:48.179069 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e52b33ed-b1cd-4023-8a98-3c7ac24cc5f6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:48.186175 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e52b33ed-b1cd-4023-8a98-3c7ac24cc5f6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:48.186175 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e52b33ed-b1cd-4023-8a98-3c7ac24cc5f6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:48.186773 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e52b33ed-b1cd-4023-8a98-3c7ac24cc5f6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:48.187093 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e52b33ed-b1cd-4023-8a98-3c7ac24cc5f6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:48.192425 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7671c00f-166f-41f6-b2a8-dc59dae7ac0b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:48.200566 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7671c00f-166f-41f6-b2a8-dc59dae7ac0b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1367 microversion: 2.1 time: 0.159296 Jun 16 15:01:48.201133 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 435/866] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:48 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:48.202885 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=100 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:48.325731 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e52b33ed-b1cd-4023-8a98-3c7ac24cc5f6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:48.333343 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e52b33ed-b1cd-4023-8a98-3c7ac24cc5f6 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1689 microversion: 2.1 time: 0.159009 Jun 16 15:01:48.333933 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 432/867] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:48 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:49.219619 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9684f1cb-8a85-4bc4-9776-c2ed353e60a5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:49.220284 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9684f1cb-8a85-4bc4-9776-c2ed353e60a5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:49.227789 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9684f1cb-8a85-4bc4-9776-c2ed353e60a5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:49.228693 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9684f1cb-8a85-4bc4-9776-c2ed353e60a5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:49.229357 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9684f1cb-8a85-4bc4-9776-c2ed353e60a5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:49.230628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9684f1cb-8a85-4bc4-9776-c2ed353e60a5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:49.350282 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a74402ce-47b1-43c6-b1aa-2f19883c4dcf tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:49.350868 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a74402ce-47b1-43c6-b1aa-2f19883c4dcf tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:49.358500 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a74402ce-47b1-43c6-b1aa-2f19883c4dcf tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:49.358939 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a74402ce-47b1-43c6-b1aa-2f19883c4dcf tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:49.359724 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a74402ce-47b1-43c6-b1aa-2f19883c4dcf tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:49.360238 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a74402ce-47b1-43c6-b1aa-2f19883c4dcf tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:49.676402 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a74402ce-47b1-43c6-b1aa-2f19883c4dcf tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:49.684562 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a74402ce-47b1-43c6-b1aa-2f19883c4dcf tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1689 microversion: 2.1 time: 0.338132 Jun 16 15:01:49.685133 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 433/868] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:49 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1689 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:49.693642 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9684f1cb-8a85-4bc4-9776-c2ed353e60a5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:49.701763 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9684f1cb-8a85-4bc4-9776-c2ed353e60a5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1367 microversion: 2.1 time: 0.486124 Jun 16 15:01:49.702327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 436/869] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:49 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1367 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:49.918063 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-05656a7a-24cf-4b91-8ad1-ce4c988040a4 req-1704f9e3-7982-4138-8d10-4b394de0a1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b469ddcc-e9b1-4c39-9c75-3b98f6f624c3", "name": "network-vif-deleted", "tag": "4ac5eb81-f7f2-453f-a4f4-fba5e3e3d8d9"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:49.926485 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-05656a7a-24cf-4b91-8ad1-ce4c988040a4 req-1704f9e3-7982-4138-8d10-4b394de0a1b7 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:49.927278 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-05656a7a-24cf-4b91-8ad1-ce4c988040a4 req-1704f9e3-7982-4138-8d10-4b394de0a1b7 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:49.939516 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-05656a7a-24cf-4b91-8ad1-ce4c988040a4 req-1704f9e3-7982-4138-8d10-4b394de0a1b7 service nova] Creating event network-vif-deleted:4ac5eb81-f7f2-453f-a4f4-fba5e3e3d8d9 for instance b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 on hv-cinder-83716 Jun 16 15:01:49.944758 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-05656a7a-24cf-4b91-8ad1-ce4c988040a4 req-1704f9e3-7982-4138-8d10-4b394de0a1b7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030291 Jun 16 15:01:49.945224 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 434/870] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:50.701802 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-105ac785-94cc-4d19-a6b0-4f52a9505ab0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:50.702449 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-105ac785-94cc-4d19-a6b0-4f52a9505ab0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:50.709974 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-105ac785-94cc-4d19-a6b0-4f52a9505ab0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:50.710427 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-105ac785-94cc-4d19-a6b0-4f52a9505ab0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:50.711204 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-105ac785-94cc-4d19-a6b0-4f52a9505ab0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:50.711638 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-105ac785-94cc-4d19-a6b0-4f52a9505ab0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:50.719907 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-71a35013-15d3-47ac-a698-3794c1b9e980 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:50.721207 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-71a35013-15d3-47ac-a698-3794c1b9e980 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:50.727870 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-71a35013-15d3-47ac-a698-3794c1b9e980 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:50.728512 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-71a35013-15d3-47ac-a698-3794c1b9e980 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:50.729278 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-71a35013-15d3-47ac-a698-3794c1b9e980 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:50.729704 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-71a35013-15d3-47ac-a698-3794c1b9e980 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:50.749391 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-105ac785-94cc-4d19-a6b0-4f52a9505ab0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:50.749841 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-105ac785-94cc-4d19-a6b0-4f52a9505ab0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:50.750297 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-105ac785-94cc-4d19-a6b0-4f52a9505ab0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lazy-loading 'fault' on Instance uuid b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:01:50.754333 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=2 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:50.776007 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=6 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:50.833480 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-105ac785-94cc-4d19-a6b0-4f52a9505ab0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:50.844368 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-105ac785-94cc-4d19-a6b0-4f52a9505ab0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 200 len: 1335 microversion: 2.1 time: 0.146481 Jun 16 15:01:50.845355 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 437/871] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:50 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 1335 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:50.909892 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-71a35013-15d3-47ac-a698-3794c1b9e980 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:50.920839 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-71a35013-15d3-47ac-a698-3794c1b9e980 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1367 microversion: 2.1 time: 0.205873 Jun 16 15:01:50.921424 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 435/872] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:50 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:51.861911 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4c1cb244-fab0-478e-b6d2-a6b940e974e7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:51.862519 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4c1cb244-fab0-478e-b6d2-a6b940e974e7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: b469ddcc-e9b1-4c39-9c75-3b98f6f624c3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:51.864474 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=6 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:51.870546 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4c1cb244-fab0-478e-b6d2-a6b940e974e7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:51.871013 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4c1cb244-fab0-478e-b6d2-a6b940e974e7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:51.871794 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4c1cb244-fab0-478e-b6d2-a6b940e974e7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:51.872231 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4c1cb244-fab0-478e-b6d2-a6b940e974e7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:51.885589 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-4c1cb244-fab0-478e-b6d2-a6b940e974e7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] HTTP exception thrown: Instance b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 could not be found. Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4c1cb244-fab0-478e-b6d2-a6b940e974e7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Request method failure captured: Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 HTTP/1.1 Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0R1qRdeZjEhysNNbSVHXfZB1VVu39rcbyLcnNKT_HPQerPm5L0NbB6Qe3z-V5li6ayT73_iT0ECmekPXm6SH7XxZQ69z8GSRHFIOq4NpoLwssK7wDD25ZHm4AFpyW0i1-tMmc4kBrYNcVnskigrdxbzetscFHHmV1CHIkoteDHIY7M Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 2b653a9971874ddb8a49b265e3783ff3 Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-6354083 Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:01:51.887809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:01:51.889405 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:01:51.889405 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-ServerRescueNegativeTestJSON-6354083 Jun 16 15:01:51.889405 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 2b653a9971874ddb8a49b265e3783ff3 Jun 16 15:01:51.889405 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-6354083 Jun 16 15:01:51.889405 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-ServerRescueNegativeTestJSON-6354083-project Jun 16 15:01:51.889405 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:01:51.889405 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:01:51.889405 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: dc31b47df1904f9da0b5c7f370b74132 Jun 16 15:01:51.889405 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-ServerRescueNegativeTestJSON-6354083-project Jun 16 15:01:51.889405 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:01:51.889405 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 could not be found. Jun 16 15:01:51.889405 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': 'b469ddcc-e9b1-4c39-9c75-3b98f6f624c3'} Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 could not be found. Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:01:51.890235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:01:51.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:01:51.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:01:51.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:01:51.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:01:51.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:01:51.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:01:51.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:01:51.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 could not be found. Jun 16 15:01:51.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:51.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:01:51.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:51.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:51.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:01:51.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:01:51.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:01:51.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:01:51.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 could not be found. Jun 16 15:01:51.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:51.893104 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4c1cb244-fab0-478e-b6d2-a6b940e974e7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Returning 404 to user: Instance b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:01:51.893104 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4c1cb244-fab0-478e-b6d2-a6b940e974e7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3" status: 404 len: 111 microversion: 2.1 time: 0.031280 Jun 16 15:01:51.893104 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 438/873] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:51 2022] GET /compute/v2.1/servers/b469ddcc-e9b1-4c39-9c75-3b98f6f624c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:01:51.898022 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-bcd91cdb-d299-4b73-a628-f9ccc9cbe398 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '.version_select at 0x7f33e1209550>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:51.915735 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-bcd91cdb-d299-4b73-a628-f9ccc9cbe398 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102761029" status: 202 len: 0 microversion: 2.1 time: 0.021498 Jun 16 15:01:51.916299 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 436/874] 10.222.0.76 () {58 vars in 1220 bytes} [Thu Jun 16 15:01:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102761029 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:01:51.938416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-dfba68f6-a0f4-4eeb-9c8e-3ccf8aa4d161 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:51.938939 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-dfba68f6-a0f4-4eeb-9c8e-3ccf8aa4d161 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:51.944911 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dfba68f6-a0f4-4eeb-9c8e-3ccf8aa4d161 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:51.945351 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dfba68f6-a0f4-4eeb-9c8e-3ccf8aa4d161 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:51.946104 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dfba68f6-a0f4-4eeb-9c8e-3ccf8aa4d161 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:51.946534 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dfba68f6-a0f4-4eeb-9c8e-3ccf8aa4d161 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:52.078031 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-dfba68f6-a0f4-4eeb-9c8e-3ccf8aa4d161 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:52.090033 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-dfba68f6-a0f4-4eeb-9c8e-3ccf8aa4d161 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1367 microversion: 2.1 time: 0.152084 Jun 16 15:01:52.090033 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 439/875] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:51 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:53.103209 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8890ff06-708a-4701-a65e-c347692bb24b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:53.103769 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-8890ff06-708a-4701-a65e-c347692bb24b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:53.111180 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8890ff06-708a-4701-a65e-c347692bb24b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:53.111634 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8890ff06-708a-4701-a65e-c347692bb24b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:53.112419 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8890ff06-708a-4701-a65e-c347692bb24b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:53.112854 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8890ff06-708a-4701-a65e-c347692bb24b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:53.243645 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-8890ff06-708a-4701-a65e-c347692bb24b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:53.251502 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8890ff06-708a-4701-a65e-c347692bb24b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1367 microversion: 2.1 time: 0.152793 Jun 16 15:01:53.252079 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 437/876] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:53 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:54.268635 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ce9d42a9-af91-43f5-8e0f-fe37bc0f7fe4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:54.269184 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ce9d42a9-af91-43f5-8e0f-fe37bc0f7fe4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:54.276186 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ce9d42a9-af91-43f5-8e0f-fe37bc0f7fe4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:54.276315 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ce9d42a9-af91-43f5-8e0f-fe37bc0f7fe4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:54.277595 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ce9d42a9-af91-43f5-8e0f-fe37bc0f7fe4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:54.278030 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ce9d42a9-af91-43f5-8e0f-fe37bc0f7fe4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:54.412019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ce9d42a9-af91-43f5-8e0f-fe37bc0f7fe4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:54.419866 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ce9d42a9-af91-43f5-8e0f-fe37bc0f7fe4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1367 microversion: 2.1 time: 0.155139 Jun 16 15:01:54.420695 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 440/877] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:54 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:54.620771 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-3005dbb0-265c-4955-a77b-add1e127cfbc req-bb24077e-fe9d-42f7-aae4-99603a1c5269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba216f58-575e-4ed9-a34c-1150c21bd527", "name": "network-vif-plugged", "status": "completed", "tag": "a89301a0-2f3e-4c5e-b399-8067e370078d"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:54.624282 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:54.630275 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-3005dbb0-265c-4955-a77b-add1e127cfbc req-bb24077e-fe9d-42f7-aae4-99603a1c5269 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:54.630740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-3005dbb0-265c-4955-a77b-add1e127cfbc req-bb24077e-fe9d-42f7-aae4-99603a1c5269 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:54.643600 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-3005dbb0-265c-4955-a77b-add1e127cfbc req-bb24077e-fe9d-42f7-aae4-99603a1c5269 service nova] Creating event network-vif-plugged:a89301a0-2f3e-4c5e-b399-8067e370078d for instance ba216f58-575e-4ed9-a34c-1150c21bd527 on hv-cinder-83716 Jun 16 15:01:54.648596 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-3005dbb0-265c-4955-a77b-add1e127cfbc req-bb24077e-fe9d-42f7-aae4-99603a1c5269 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213046 Jun 16 15:01:54.649209 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 438/878] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:54.799922 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-51fa1570-416e-484f-9896-75099c053bac tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:54.800769 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-51fa1570-416e-484f-9896-75099c053bac tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:54.807088 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-51fa1570-416e-484f-9896-75099c053bac tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:54.807545 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-51fa1570-416e-484f-9896-75099c053bac tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:54.809511 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-51fa1570-416e-484f-9896-75099c053bac tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:54.810384 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-51fa1570-416e-484f-9896-75099c053bac tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:54.835322 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-51fa1570-416e-484f-9896-75099c053bac tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:01:54.911906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-51fa1570-416e-484f-9896-75099c053bac tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 204 len: 0 microversion: 2.1 time: 0.116363 Jun 16 15:01:54.912830 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 441/879] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:01:54 2022] DELETE /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:01:54.921887 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-483194c8-a36e-41e0-a3cb-97daaafeef2c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:54.922637 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-483194c8-a36e-41e0-a3cb-97daaafeef2c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:54.928894 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-483194c8-a36e-41e0-a3cb-97daaafeef2c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:54.929342 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-483194c8-a36e-41e0-a3cb-97daaafeef2c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:54.930100 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-483194c8-a36e-41e0-a3cb-97daaafeef2c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:54.930530 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-483194c8-a36e-41e0-a3cb-97daaafeef2c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:55.061044 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-483194c8-a36e-41e0-a3cb-97daaafeef2c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:55.068413 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-483194c8-a36e-41e0-a3cb-97daaafeef2c tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1507 microversion: 2.1 time: 0.151004 Jun 16 15:01:55.068991 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 439/880] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:54 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:55.437987 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-964bf451-ee0b-409e-b147-059e2ba33df1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:55.438679 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-964bf451-ee0b-409e-b147-059e2ba33df1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:55.445156 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-964bf451-ee0b-409e-b147-059e2ba33df1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:55.445600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-964bf451-ee0b-409e-b147-059e2ba33df1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:55.446350 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-964bf451-ee0b-409e-b147-059e2ba33df1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:55.446807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-964bf451-ee0b-409e-b147-059e2ba33df1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:55.574698 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-964bf451-ee0b-409e-b147-059e2ba33df1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:55.577023 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:55.583923 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-964bf451-ee0b-409e-b147-059e2ba33df1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1367 microversion: 2.1 time: 0.150234 Jun 16 15:01:55.584491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 442/881] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:55 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:56.085367 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-9214a15e-5ec1-4f91-a71e-138044aea3c0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:56.085976 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-9214a15e-5ec1-4f91-a71e-138044aea3c0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:56.092398 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9214a15e-5ec1-4f91-a71e-138044aea3c0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:56.092839 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9214a15e-5ec1-4f91-a71e-138044aea3c0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:56.093615 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9214a15e-5ec1-4f91-a71e-138044aea3c0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:56.094039 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9214a15e-5ec1-4f91-a71e-138044aea3c0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:56.223875 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-9214a15e-5ec1-4f91-a71e-138044aea3c0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:56.231835 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-9214a15e-5ec1-4f91-a71e-138044aea3c0 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1507 microversion: 2.1 time: 0.150320 Jun 16 15:01:56.232409 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 440/882] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:56 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:56.602270 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ae737b56-8fe6-44a0-8109-2a4fdf73cd16 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:56.602887 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ae737b56-8fe6-44a0-8109-2a4fdf73cd16 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:56.610413 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ae737b56-8fe6-44a0-8109-2a4fdf73cd16 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:56.610864 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ae737b56-8fe6-44a0-8109-2a4fdf73cd16 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:56.611662 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ae737b56-8fe6-44a0-8109-2a4fdf73cd16 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:56.612126 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ae737b56-8fe6-44a0-8109-2a4fdf73cd16 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:56.743435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ae737b56-8fe6-44a0-8109-2a4fdf73cd16 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:56.751357 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ae737b56-8fe6-44a0-8109-2a4fdf73cd16 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1367 microversion: 2.1 time: 0.153293 Jun 16 15:01:56.752031 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 443/883] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:56 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:57.249333 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-9acfe4fc-bab4-4dac-b8b1-5e6035e611e8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:57.249854 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-9acfe4fc-bab4-4dac-b8b1-5e6035e611e8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:57.256569 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9acfe4fc-bab4-4dac-b8b1-5e6035e611e8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:57.256704 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9acfe4fc-bab4-4dac-b8b1-5e6035e611e8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:57.257430 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9acfe4fc-bab4-4dac-b8b1-5e6035e611e8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:57.257854 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9acfe4fc-bab4-4dac-b8b1-5e6035e611e8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:57.392145 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-9acfe4fc-bab4-4dac-b8b1-5e6035e611e8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:57.399448 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-9acfe4fc-bab4-4dac-b8b1-5e6035e611e8 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 200 len: 1507 microversion: 2.1 time: 0.154562 Jun 16 15:01:57.400032 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 441/884] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:57 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:57.775702 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a4dae146-648c-4a78-9e46-51fc62b62879 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:57.778744 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a4dae146-648c-4a78-9e46-51fc62b62879 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:57.781228 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:57.788316 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a4dae146-648c-4a78-9e46-51fc62b62879 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:57.789038 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a4dae146-648c-4a78-9e46-51fc62b62879 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:57.789824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a4dae146-648c-4a78-9e46-51fc62b62879 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:57.794701 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a4dae146-648c-4a78-9e46-51fc62b62879 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:57.827394 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-5af4768a-ce49-4290-8b18-c3dc18a42ab7 req-02a42597-c1eb-49cc-a180-6aeefc9a6a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e786be21-8e43-4fdb-9790-7aabbad8a47c", "name": "network-vif-deleted", "tag": "0a04f9d9-973f-46a8-a654-59f421e343ef"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:57.836592 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-5af4768a-ce49-4290-8b18-c3dc18a42ab7 req-02a42597-c1eb-49cc-a180-6aeefc9a6a6c service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:57.837084 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-5af4768a-ce49-4290-8b18-c3dc18a42ab7 req-02a42597-c1eb-49cc-a180-6aeefc9a6a6c service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:57.852291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-5af4768a-ce49-4290-8b18-c3dc18a42ab7 req-02a42597-c1eb-49cc-a180-6aeefc9a6a6c service nova] Creating event network-vif-deleted:0a04f9d9-973f-46a8-a654-59f421e343ef for instance e786be21-8e43-4fdb-9790-7aabbad8a47c on hv-cinder-83716 Jun 16 15:01:57.858775 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-5af4768a-ce49-4290-8b18-c3dc18a42ab7 req-02a42597-c1eb-49cc-a180-6aeefc9a6a6c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034611 Jun 16 15:01:57.860096 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 442/885] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:01:57.960957 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a4dae146-648c-4a78-9e46-51fc62b62879 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:57.969699 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a4dae146-648c-4a78-9e46-51fc62b62879 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1557 microversion: 2.1 time: 0.204612 Jun 16 15:01:57.970264 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 444/886] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:57 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1557 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:57.987475 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3f10b9d6-7f51-4d6f-aa2a-9411c201c95b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:57.988089 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-3f10b9d6-7f51-4d6f-aa2a-9411c201c95b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:57.994596 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3f10b9d6-7f51-4d6f-aa2a-9411c201c95b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:57.995285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3f10b9d6-7f51-4d6f-aa2a-9411c201c95b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:57.996303 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3f10b9d6-7f51-4d6f-aa2a-9411c201c95b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:57.996747 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3f10b9d6-7f51-4d6f-aa2a-9411c201c95b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:58.074782 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3f10b9d6-7f51-4d6f-aa2a-9411c201c95b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091436 Jun 16 15:01:58.075366 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 443/887] 10.222.0.76 () {58 vars in 1274 bytes} [Thu Jun 16 15:01:57 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:58.418088 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-02b60d91-7203-4127-b3f8-00f1a06b7ff7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:58.418665 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-02b60d91-7203-4127-b3f8-00f1a06b7ff7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: e786be21-8e43-4fdb-9790-7aabbad8a47c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:58.425227 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-02b60d91-7203-4127-b3f8-00f1a06b7ff7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:58.426182 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-02b60d91-7203-4127-b3f8-00f1a06b7ff7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:58.426687 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-02b60d91-7203-4127-b3f8-00f1a06b7ff7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:58.427128 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-02b60d91-7203-4127-b3f8-00f1a06b7ff7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:58.452017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-02b60d91-7203-4127-b3f8-00f1a06b7ff7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] HTTP exception thrown: Instance e786be21-8e43-4fdb-9790-7aabbad8a47c could not be found. Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-02b60d91-7203-4127-b3f8-00f1a06b7ff7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Request method failure captured: Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c HTTP/1.1 Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0R1qRdeZjEhysNNbSVHXfZB1VVu39rcbyLcnNKT_HPQerPm5L0NbB6Qe3z-V5li6ayT73_iT0ECmekPXm6SH7XxZQ69z8GSRHFIOq4NpoLwssK7wDD25ZHm4AFpyW0i1-tMmc4kBrYNcVnskigrdxbzetscFHHmV1CHIkoteDHIY7M Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 2b653a9971874ddb8a49b265e3783ff3 Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-6354083 Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:01:58.453688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:01:58.455082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:01:58.455082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-ServerRescueNegativeTestJSON-6354083 Jun 16 15:01:58.455082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 2b653a9971874ddb8a49b265e3783ff3 Jun 16 15:01:58.455082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-6354083 Jun 16 15:01:58.455082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-ServerRescueNegativeTestJSON-6354083-project Jun 16 15:01:58.455082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:01:58.455082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:01:58.455082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: dc31b47df1904f9da0b5c7f370b74132 Jun 16 15:01:58.455082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-ServerRescueNegativeTestJSON-6354083-project Jun 16 15:01:58.455082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:01:58.455082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance e786be21-8e43-4fdb-9790-7aabbad8a47c could not be found. Jun 16 15:01:58.455082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': 'e786be21-8e43-4fdb-9790-7aabbad8a47c'} Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e786be21-8e43-4fdb-9790-7aabbad8a47c could not be found. Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:01:58.455906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:01:58.457098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:01:58.457098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:01:58.457098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:01:58.457098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:01:58.457098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:01:58.457098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:01:58.457098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:01:58.457098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e786be21-8e43-4fdb-9790-7aabbad8a47c could not be found. Jun 16 15:01:58.457098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:58.457098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:01:58.457098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:58.457098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:58.457098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:01:58.457098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:01:58.457098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:01:58.457098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:01:58.457098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e786be21-8e43-4fdb-9790-7aabbad8a47c could not be found. Jun 16 15:01:58.457098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:01:58.458161 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-02b60d91-7203-4127-b3f8-00f1a06b7ff7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Returning 404 to user: Instance e786be21-8e43-4fdb-9790-7aabbad8a47c could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:01:58.458161 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-02b60d91-7203-4127-b3f8-00f1a06b7ff7 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c" status: 404 len: 111 microversion: 2.1 time: 0.042102 Jun 16 15:01:58.458161 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 445/888] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:58 2022] GET /compute/v2.1/servers/e786be21-8e43-4fdb-9790-7aabbad8a47c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:01:58.465010 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-92f45aa0-7cdc-4934-a96e-da13981cecb3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:58.465635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-92f45aa0-7cdc-4934-a96e-da13981cecb3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:58.472100 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-92f45aa0-7cdc-4934-a96e-da13981cecb3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:58.472550 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-92f45aa0-7cdc-4934-a96e-da13981cecb3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:58.473313 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-92f45aa0-7cdc-4934-a96e-da13981cecb3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:58.473741 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-92f45aa0-7cdc-4934-a96e-da13981cecb3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:58.501248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-92f45aa0-7cdc-4934-a96e-da13981cecb3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Going to try to terminate instance {{(pid=117443) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:01:58.585175 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-92f45aa0-7cdc-4934-a96e-da13981cecb3 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "DELETE /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 204 len: 0 microversion: 2.1 time: 0.124474 Jun 16 15:01:58.585733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 444/889] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:01:58 2022] DELETE /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:01:58.594792 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-37220eef-22c8-4d7c-a1cb-1e92c518a8fb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:58.595463 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-37220eef-22c8-4d7c-a1cb-1e92c518a8fb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:58.601720 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-37220eef-22c8-4d7c-a1cb-1e92c518a8fb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:58.602237 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-37220eef-22c8-4d7c-a1cb-1e92c518a8fb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:58.603096 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-37220eef-22c8-4d7c-a1cb-1e92c518a8fb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:58.603590 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-37220eef-22c8-4d7c-a1cb-1e92c518a8fb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:58.844252 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-37220eef-22c8-4d7c-a1cb-1e92c518a8fb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:58.852479 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-37220eef-22c8-4d7c-a1cb-1e92c518a8fb tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.261970 Jun 16 15:01:58.853295 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 446/890] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:58 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:59.871497 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8fec1bd6-7c1c-4c53-a665-4911c3ad3a32 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:59.872316 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-8fec1bd6-7c1c-4c53-a665-4911c3ad3a32 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:59.879110 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8fec1bd6-7c1c-4c53-a665-4911c3ad3a32 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:59.879563 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8fec1bd6-7c1c-4c53-a665-4911c3ad3a32 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:59.880555 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8fec1bd6-7c1c-4c53-a665-4911c3ad3a32 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:59.880990 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8fec1bd6-7c1c-4c53-a665-4911c3ad3a32 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:59.888228 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-a468eacf-9289-431b-90aa-59989e665234 req-898adebf-523f-469b-88eb-530ec4786eec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba216f58-575e-4ed9-a34c-1150c21bd527", "tag": "a89301a0-2f3e-4c5e-b399-8067e370078d"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:59.897304 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-a468eacf-9289-431b-90aa-59989e665234 req-898adebf-523f-469b-88eb-530ec4786eec service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:59.897754 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-a468eacf-9289-431b-90aa-59989e665234 req-898adebf-523f-469b-88eb-530ec4786eec service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:59.909899 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-a468eacf-9289-431b-90aa-59989e665234 req-898adebf-523f-469b-88eb-530ec4786eec service nova] Creating event network-changed:a89301a0-2f3e-4c5e-b399-8067e370078d for instance ba216f58-575e-4ed9-a34c-1150c21bd527 on hv-cinder-83716 Jun 16 15:01:59.915013 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-a468eacf-9289-431b-90aa-59989e665234 req-898adebf-523f-469b-88eb-530ec4786eec service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030555 Jun 16 15:01:59.915613 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 447/891] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:02:00.023280 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-8fec1bd6-7c1c-4c53-a665-4911c3ad3a32 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:00.031470 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8fec1bd6-7c1c-4c53-a665-4911c3ad3a32 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.164760 Jun 16 15:02:00.032155 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 445/892] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:59 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:01.049668 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3154e6cb-a54f-4bad-b6dc-fa44489cfeba tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:01.050369 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3154e6cb-a54f-4bad-b6dc-fa44489cfeba tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:01.057238 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3154e6cb-a54f-4bad-b6dc-fa44489cfeba tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:01.057748 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3154e6cb-a54f-4bad-b6dc-fa44489cfeba tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:01.059045 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3154e6cb-a54f-4bad-b6dc-fa44489cfeba tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:01.059490 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3154e6cb-a54f-4bad-b6dc-fa44489cfeba tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:01.272567 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3154e6cb-a54f-4bad-b6dc-fa44489cfeba tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc31b47df1904f9da0b5c7f370b74132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b653a9971874ddb8a49b265e3783ff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:01.281767 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3154e6cb-a54f-4bad-b6dc-fa44489cfeba tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 200 len: 1522 microversion: 2.1 time: 0.236333 Jun 16 15:02:01.282340 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 448/893] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:01 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:01.541867 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-ff11c82b-1002-4437-9738-762b5a36e32e req-2d1d6730-ff9b-4e93-ab5a-13c5c0d34057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2fec0d-b149-4a09-8708-1654b2d88ac0", "name": "network-vif-deleted", "tag": "cc40689c-679f-4519-9590-de4741af856a"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:01.551812 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-ff11c82b-1002-4437-9738-762b5a36e32e req-2d1d6730-ff9b-4e93-ab5a-13c5c0d34057 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:01.552253 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-ff11c82b-1002-4437-9738-762b5a36e32e req-2d1d6730-ff9b-4e93-ab5a-13c5c0d34057 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:01.564995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-ff11c82b-1002-4437-9738-762b5a36e32e req-2d1d6730-ff9b-4e93-ab5a-13c5c0d34057 service nova] Creating event network-vif-deleted:cc40689c-679f-4519-9590-de4741af856a for instance 7d2fec0d-b149-4a09-8708-1654b2d88ac0 on hv-cinder-83716 Jun 16 15:02:01.570124 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-ff11c82b-1002-4437-9738-762b5a36e32e req-2d1d6730-ff9b-4e93-ab5a-13c5c0d34057 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032017 Jun 16 15:02:01.570932 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 446/894] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:02.298666 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9dfd4bb2-0458-49cb-a732-8a7286aaa3e9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:02.299282 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9dfd4bb2-0458-49cb-a732-8a7286aaa3e9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] [instance: 7d2fec0d-b149-4a09-8708-1654b2d88ac0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:02.305912 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9dfd4bb2-0458-49cb-a732-8a7286aaa3e9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:02.306364 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9dfd4bb2-0458-49cb-a732-8a7286aaa3e9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:02.307128 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9dfd4bb2-0458-49cb-a732-8a7286aaa3e9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:02.307569 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9dfd4bb2-0458-49cb-a732-8a7286aaa3e9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:02.320671 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-9dfd4bb2-0458-49cb-a732-8a7286aaa3e9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] HTTP exception thrown: Instance 7d2fec0d-b149-4a09-8708-1654b2d88ac0 could not be found. Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9dfd4bb2-0458-49cb-a732-8a7286aaa3e9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Request method failure captured: Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 HTTP/1.1 Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0R1qRdeZjEhysNNbSVHXfZB1VVu39rcbyLcnNKT_HPQerPm5L0NbB6Qe3z-V5li6ayT73_iT0ECmekPXm6SH7XxZQ69z8GSRHFIOq4NpoLwssK7wDD25ZHm4AFpyW0i1-tMmc4kBrYNcVnskigrdxbzetscFHHmV1CHIkoteDHIY7M Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 2b653a9971874ddb8a49b265e3783ff3 Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-6354083 Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:02:02.322327 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:02:02.323915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2b653a9971874ddb8a49b265e3783ff3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:02:02.323915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-ServerRescueNegativeTestJSON-6354083 Jun 16 15:02:02.323915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 2b653a9971874ddb8a49b265e3783ff3 Jun 16 15:02:02.323915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-6354083 Jun 16 15:02:02.323915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-ServerRescueNegativeTestJSON-6354083-project Jun 16 15:02:02.323915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:02:02.323915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:02:02.323915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: dc31b47df1904f9da0b5c7f370b74132 Jun 16 15:02:02.323915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-ServerRescueNegativeTestJSON-6354083-project Jun 16 15:02:02.323915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:02:02.323915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance 7d2fec0d-b149-4a09-8708-1654b2d88ac0 could not be found. Jun 16 15:02:02.323915 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': '7d2fec0d-b149-4a09-8708-1654b2d88ac0'} Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d2fec0d-b149-4a09-8708-1654b2d88ac0 could not be found. Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:02:02.324989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:02:02.326491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:02:02.326491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:02:02.326491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:02:02.326491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:02:02.326491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:02:02.326491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:02:02.326491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:02:02.326491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d2fec0d-b149-4a09-8708-1654b2d88ac0 could not be found. Jun 16 15:02:02.326491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:02:02.326491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:02:02.326491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:02:02.326491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:02:02.326491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:02:02.326491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:02:02.326491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:02:02.326491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:02:02.326491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d2fec0d-b149-4a09-8708-1654b2d88ac0 could not be found. Jun 16 15:02:02.326491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:02:02.328017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9dfd4bb2-0458-49cb-a732-8a7286aaa3e9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] Returning 404 to user: Instance 7d2fec0d-b149-4a09-8708-1654b2d88ac0 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:02:02.328017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9dfd4bb2-0458-49cb-a732-8a7286aaa3e9 tempest-ServerRescueNegativeTestJSON-6354083 tempest-ServerRescueNegativeTestJSON-6354083-project] 10.222.0.76 "GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0" status: 404 len: 111 microversion: 2.1 time: 0.028953 Jun 16 15:02:02.328017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 449/895] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:02 2022] GET /compute/v2.1/servers/7d2fec0d-b149-4a09-8708-1654b2d88ac0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:02:03.288399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b07c46c9-bc52-4320-ab2e-cace5146def6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:03.288977 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b07c46c9-bc52-4320-ab2e-cace5146def6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:03.296850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b07c46c9-bc52-4320-ab2e-cace5146def6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:03.297317 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b07c46c9-bc52-4320-ab2e-cace5146def6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:03.298063 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b07c46c9-bc52-4320-ab2e-cace5146def6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:03.298493 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b07c46c9-bc52-4320-ab2e-cace5146def6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:03.323669 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b07c46c9-bc52-4320-ab2e-cace5146def6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9/ips" status: 200 len: 152 microversion: 2.20 time: 0.039482 Jun 16 15:02:03.324291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 447/896] 10.222.0.76 () {60 vars in 1288 bytes} [Thu Jun 16 15:02:03 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 15:02:05.176108 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e8830fc9-4c48-46c9-8155-dd679a243cca tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:05.176695 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e8830fc9-4c48-46c9-8155-dd679a243cca tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:05.183851 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e8830fc9-4c48-46c9-8155-dd679a243cca tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:05.184307 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e8830fc9-4c48-46c9-8155-dd679a243cca tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:05.185079 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e8830fc9-4c48-46c9-8155-dd679a243cca tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:05.185514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e8830fc9-4c48-46c9-8155-dd679a243cca tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:05.211920 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-e8830fc9-4c48-46c9-8155-dd679a243cca tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lazy-loading 'flavor' on Instance uuid c044f7d0-a298-4c42-9a40-2bc494b1cdc9 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:02:05.500072 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e8830fc9-4c48-46c9-8155-dd679a243cca tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "POST /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9/action" status: 202 len: 0 microversion: 2.20 time: 0.327407 Jun 16 15:02:05.501569 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 450/897] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Jun 16 15:02:05 2022] POST /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:02:05.509144 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-46bf89a0-198b-4019-8cf4-42fbe4b300ac tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:05.514698 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-46bf89a0-198b-4019-8cf4-42fbe4b300ac tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:05.522245 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-46bf89a0-198b-4019-8cf4-42fbe4b300ac tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:05.522817 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-46bf89a0-198b-4019-8cf4-42fbe4b300ac tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:05.523580 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-46bf89a0-198b-4019-8cf4-42fbe4b300ac tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:05.524063 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-46bf89a0-198b-4019-8cf4-42fbe4b300ac tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:06.043535 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-46bf89a0-198b-4019-8cf4-42fbe4b300ac tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:06.053826 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-46bf89a0-198b-4019-8cf4-42fbe4b300ac tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:06.055335 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-46bf89a0-198b-4019-8cf4-42fbe4b300ac tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:06.056546 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-46bf89a0-198b-4019-8cf4-42fbe4b300ac tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1721 microversion: 2.20 time: 0.551514 Jun 16 15:02:06.057102 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 448/898] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:05 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1721 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:07.074239 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-fd55dda5-0697-42d9-9284-35441c6f0c54 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:07.074884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-fd55dda5-0697-42d9-9284-35441c6f0c54 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:07.081807 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fd55dda5-0697-42d9-9284-35441c6f0c54 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:07.082256 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fd55dda5-0697-42d9-9284-35441c6f0c54 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:07.083019 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fd55dda5-0697-42d9-9284-35441c6f0c54 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:07.083453 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fd55dda5-0697-42d9-9284-35441c6f0c54 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:07.165361 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c6fb5ae7-e53b-4dab-b84f-e4125be2eca7 tempest-VolumesGetTestJSON-2090414623 tempest-VolumesGetTestJSON-2090414623-project] Action: 'create', calling method: .version_select at 0x7f33e17fc670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2106413723", "metadata": {"Type": "work"}}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:07.222881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fd55dda5-0697-42d9-9284-35441c6f0c54 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:07.231420 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fd55dda5-0697-42d9-9284-35441c6f0c54 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:07.233027 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fd55dda5-0697-42d9-9284-35441c6f0c54 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:07.234163 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-fd55dda5-0697-42d9-9284-35441c6f0c54 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1721 microversion: 2.20 time: 0.163760 Jun 16 15:02:07.234712 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 449/899] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:07 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:07.451627 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c6fb5ae7-e53b-4dab-b84f-e4125be2eca7 tempest-VolumesGetTestJSON-2090414623 tempest-VolumesGetTestJSON-2090414623-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.404003 Jun 16 15:02:07.452270 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 451/900] 10.222.0.76 () {60 vars in 1155 bytes} [Thu Jun 16 15:02:07 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 405 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 15:02:07.463261 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-89493dd2-6113-4d8b-bd4d-038aaec77ea5 tempest-VolumesGetTestJSON-2090414623 tempest-VolumesGetTestJSON-2090414623-project] Calling method '.version_select at 0x7f33e11daee0>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:07.514958 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-89493dd2-6113-4d8b-bd4d-038aaec77ea5 tempest-VolumesGetTestJSON-2090414623 tempest-VolumesGetTestJSON-2090414623-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/5ce8ac57-7467-47c6-9946-5c62b28fa23b" status: 200 len: 353 microversion: 2.1 time: 0.055516 Jun 16 15:02:07.515593 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 450/901] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Jun 16 15:02:07 2022] GET /compute/v2.1/os-volumes/5ce8ac57-7467-47c6-9946-5c62b28fa23b => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:08.253985 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4be87613-43b6-4af3-a984-bd3317f2141f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:08.254732 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4be87613-43b6-4af3-a984-bd3317f2141f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:08.262274 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4be87613-43b6-4af3-a984-bd3317f2141f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:08.262720 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4be87613-43b6-4af3-a984-bd3317f2141f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:08.263471 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4be87613-43b6-4af3-a984-bd3317f2141f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:08.263933 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4be87613-43b6-4af3-a984-bd3317f2141f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:08.394800 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4be87613-43b6-4af3-a984-bd3317f2141f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:08.403142 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4be87613-43b6-4af3-a984-bd3317f2141f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:08.405762 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4be87613-43b6-4af3-a984-bd3317f2141f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:08.408201 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4be87613-43b6-4af3-a984-bd3317f2141f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1721 microversion: 2.20 time: 0.158008 Jun 16 15:02:08.409427 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 452/902] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:08 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:08.528444 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-91c8c6b4-db8c-4605-af26-cdcf3aca3745 tempest-VolumesGetTestJSON-2090414623 tempest-VolumesGetTestJSON-2090414623-project] Calling method '.version_select at 0x7f33e1303940>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:08.574726 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-91c8c6b4-db8c-4605-af26-cdcf3aca3745 tempest-VolumesGetTestJSON-2090414623 tempest-VolumesGetTestJSON-2090414623-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/5ce8ac57-7467-47c6-9946-5c62b28fa23b" status: 200 len: 354 microversion: 2.1 time: 0.050722 Jun 16 15:02:08.575285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 451/903] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Jun 16 15:02:08 2022] GET /compute/v2.1/os-volumes/5ce8ac57-7467-47c6-9946-5c62b28fa23b => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:08.586058 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-49b32fe6-c06b-408e-b2f4-f4ca6a81cae3 tempest-VolumesGetTestJSON-2090414623 tempest-VolumesGetTestJSON-2090414623-project] Calling method '.version_select at 0x7f33e12950d0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:08.631780 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-49b32fe6-c06b-408e-b2f4-f4ca6a81cae3 tempest-VolumesGetTestJSON-2090414623 tempest-VolumesGetTestJSON-2090414623-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/5ce8ac57-7467-47c6-9946-5c62b28fa23b" status: 200 len: 354 microversion: 2.1 time: 0.049341 Jun 16 15:02:08.632342 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 453/904] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Jun 16 15:02:08 2022] GET /compute/v2.1/os-volumes/5ce8ac57-7467-47c6-9946-5c62b28fa23b => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:08.648904 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b91bbbbf-fd72-4a73-9f7d-519fdfd43367 tempest-VolumesGetTestJSON-2090414623 tempest-VolumesGetTestJSON-2090414623-project] Calling method '.version_select at 0x7f33e1252b80>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:08.709892 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b91bbbbf-fd72-4a73-9f7d-519fdfd43367 tempest-VolumesGetTestJSON-2090414623 tempest-VolumesGetTestJSON-2090414623-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/5ce8ac57-7467-47c6-9946-5c62b28fa23b" status: 202 len: 0 microversion: 2.1 time: 0.064678 Jun 16 15:02:08.710422 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 452/905] 10.222.0.76 () {58 vars in 1247 bytes} [Thu Jun 16 15:02:08 2022] DELETE /compute/v2.1/os-volumes/5ce8ac57-7467-47c6-9946-5c62b28fa23b => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 15:02:08.718183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d94ffbaa-9f2a-4af3-b927-1b53ec7ef22b tempest-VolumesGetTestJSON-2090414623 tempest-VolumesGetTestJSON-2090414623-project] Calling method '.version_select at 0x7f33e1295670>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:08.766314 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d94ffbaa-9f2a-4af3-b927-1b53ec7ef22b tempest-VolumesGetTestJSON-2090414623 tempest-VolumesGetTestJSON-2090414623-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/5ce8ac57-7467-47c6-9946-5c62b28fa23b" status: 200 len: 353 microversion: 2.1 time: 0.051794 Jun 16 15:02:08.766888 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 454/906] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Jun 16 15:02:08 2022] GET /compute/v2.1/os-volumes/5ce8ac57-7467-47c6-9946-5c62b28fa23b => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:09.430385 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b305ac0f-c5ff-43c4-ac14-7a2aa5ef78eb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:09.430989 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b305ac0f-c5ff-43c4-ac14-7a2aa5ef78eb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:09.437166 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b305ac0f-c5ff-43c4-ac14-7a2aa5ef78eb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:09.437616 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b305ac0f-c5ff-43c4-ac14-7a2aa5ef78eb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:09.438370 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b305ac0f-c5ff-43c4-ac14-7a2aa5ef78eb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:09.438806 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b305ac0f-c5ff-43c4-ac14-7a2aa5ef78eb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:09.571310 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b305ac0f-c5ff-43c4-ac14-7a2aa5ef78eb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:09.579884 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b305ac0f-c5ff-43c4-ac14-7a2aa5ef78eb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:09.581386 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b305ac0f-c5ff-43c4-ac14-7a2aa5ef78eb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:09.582542 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b305ac0f-c5ff-43c4-ac14-7a2aa5ef78eb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1721 microversion: 2.20 time: 0.156171 Jun 16 15:02:09.583111 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 453/907] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:09 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:09.779255 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0908f5c6-884d-456b-beae-6d4d12167f1f tempest-VolumesGetTestJSON-2090414623 tempest-VolumesGetTestJSON-2090414623-project] Calling method '.version_select at 0x7f33e12a0af0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:09.809509 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-0908f5c6-884d-456b-beae-6d4d12167f1f tempest-VolumesGetTestJSON-2090414623 tempest-VolumesGetTestJSON-2090414623-project] HTTP exception thrown: Volume 5ce8ac57-7467-47c6-9946-5c62b28fa23b could not be found. Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0908f5c6-884d-456b-beae-6d4d12167f1f tempest-VolumesGetTestJSON-2090414623 tempest-VolumesGetTestJSON-2090414623-project] Request method failure captured: Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/os-volumes/5ce8ac57-7467-47c6-9946-5c62b28fa23b HTTP/1.1 Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0XuVoSlkBL3jQXyEE_4FZJzQYT-KEbuAt53rxNxNlNU0WAP1vT3hvfi8rRistjanOarIKw0tWZxgxnPkBkJnY4D6-zeW8bSq7unbsc0O87nXKajAdOYYyQ4jpHTNjZwr2QUtHo772uaTXf_8qsu5NBmV4hV_bjEx628OEQtAiYK5uQ Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: de07b79ee1ae43008f470d0a7270031b Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-VolumesGetTestJSON-2090414623 Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:02:09.811998 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:02:09.813824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/de07b79ee1ae43008f470d0a7270031b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/de07b79ee1ae43008f470d0a7270031b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_de07b79ee1ae43008f470d0a7270031b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/de07b79ee1ae43008f470d0a7270031b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:02:09.813824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-VolumesGetTestJSON-2090414623 Jun 16 15:02:09.813824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: de07b79ee1ae43008f470d0a7270031b Jun 16 15:02:09.813824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-VolumesGetTestJSON-2090414623 Jun 16 15:02:09.813824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-VolumesGetTestJSON-2090414623-project Jun 16 15:02:09.813824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:02:09.813824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:02:09.813824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 0ff148904a4c4a8e94f842e3aed52559 Jun 16 15:02:09.813824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-VolumesGetTestJSON-2090414623-project Jun 16 15:02:09.813824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: Jun 16 15:02:09.813824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Volume 5ce8ac57-7467-47c6-9946-5c62b28fa23b could not be found. Jun 16 15:02:09.813824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': '5ce8ac57-7467-47c6-9946-5c62b28fa23b'} Jun 16 15:02:09.813824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ce8ac57-7467-47c6-9946-5c62b28fa23b could not be found. (HTTP 404) (Request-ID: req-fa964b39-d100-434f-9993-1ec3c5fc471c) Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:02:09.815109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 15:02:09.817363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ce8ac57-7467-47c6-9946-5c62b28fa23b could not be found. Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 15:02:09.819320 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:02:09.821842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ce8ac57-7467-47c6-9946-5c62b28fa23b could not be found. Jun 16 15:02:09.821842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:02:09.821842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:02:09.821842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:02:09.821842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:02:09.821842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:02:09.821842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:02:09.821842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:02:09.821842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:02:09.821842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ce8ac57-7467-47c6-9946-5c62b28fa23b could not be found. Jun 16 15:02:09.821842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:02:09.821842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0908f5c6-884d-456b-beae-6d4d12167f1f tempest-VolumesGetTestJSON-2090414623 tempest-VolumesGetTestJSON-2090414623-project] Returning 404 to user: Volume 5ce8ac57-7467-47c6-9946-5c62b28fa23b could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:02:09.821842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0908f5c6-884d-456b-beae-6d4d12167f1f tempest-VolumesGetTestJSON-2090414623 tempest-VolumesGetTestJSON-2090414623-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/5ce8ac57-7467-47c6-9946-5c62b28fa23b" status: 404 len: 109 microversion: 2.1 time: 0.038645 Jun 16 15:02:09.821842 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 455/908] 10.222.0.76 () {58 vars in 1244 bytes} [Thu Jun 16 15:02:09 2022] GET /compute/v2.1/os-volumes/5ce8ac57-7467-47c6-9946-5c62b28fa23b => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:02:10.600708 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-11f9047b-f1d3-4935-930b-d0dfbef15a8c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:10.601307 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-11f9047b-f1d3-4935-930b-d0dfbef15a8c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:10.608044 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-11f9047b-f1d3-4935-930b-d0dfbef15a8c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:10.608494 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-11f9047b-f1d3-4935-930b-d0dfbef15a8c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:10.609268 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-11f9047b-f1d3-4935-930b-d0dfbef15a8c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:10.610279 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-11f9047b-f1d3-4935-930b-d0dfbef15a8c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:10.906772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-11f9047b-f1d3-4935-930b-d0dfbef15a8c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:10.909343 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:10.916759 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-11f9047b-f1d3-4935-930b-d0dfbef15a8c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:10.918262 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-11f9047b-f1d3-4935-930b-d0dfbef15a8c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:10.919416 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-11f9047b-f1d3-4935-930b-d0dfbef15a8c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1721 microversion: 2.20 time: 0.322662 Jun 16 15:02:10.919991 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 454/909] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:10 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1721 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:11.937965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b25db6e8-7b6c-4878-9041-e32ec735ba11 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:11.938752 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b25db6e8-7b6c-4878-9041-e32ec735ba11 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:11.945200 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b25db6e8-7b6c-4878-9041-e32ec735ba11 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:11.945728 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b25db6e8-7b6c-4878-9041-e32ec735ba11 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:11.946607 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b25db6e8-7b6c-4878-9041-e32ec735ba11 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:11.947106 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b25db6e8-7b6c-4878-9041-e32ec735ba11 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:12.081027 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b25db6e8-7b6c-4878-9041-e32ec735ba11 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:12.093874 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b25db6e8-7b6c-4878-9041-e32ec735ba11 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:12.100242 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b25db6e8-7b6c-4878-9041-e32ec735ba11 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:12.101689 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b25db6e8-7b6c-4878-9041-e32ec735ba11 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1721 microversion: 2.20 time: 0.168203 Jun 16 15:02:12.102207 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 456/910] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:11 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:13.122353 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c8e22c4a-5a0d-44bd-85e2-1fdbad9969d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:13.122955 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c8e22c4a-5a0d-44bd-85e2-1fdbad9969d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:13.131052 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c8e22c4a-5a0d-44bd-85e2-1fdbad9969d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:13.131497 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c8e22c4a-5a0d-44bd-85e2-1fdbad9969d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:13.132286 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c8e22c4a-5a0d-44bd-85e2-1fdbad9969d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:13.132715 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c8e22c4a-5a0d-44bd-85e2-1fdbad9969d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:13.270105 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c8e22c4a-5a0d-44bd-85e2-1fdbad9969d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:13.278517 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c8e22c4a-5a0d-44bd-85e2-1fdbad9969d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:13.280075 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c8e22c4a-5a0d-44bd-85e2-1fdbad9969d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:13.281666 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c8e22c4a-5a0d-44bd-85e2-1fdbad9969d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1721 microversion: 2.20 time: 0.163497 Jun 16 15:02:13.282327 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 455/911] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:13 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:14.300138 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ed3d0526-9f41-48c3-b2a1-338d30f4067b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:14.300744 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ed3d0526-9f41-48c3-b2a1-338d30f4067b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:14.307848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ed3d0526-9f41-48c3-b2a1-338d30f4067b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:14.308297 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ed3d0526-9f41-48c3-b2a1-338d30f4067b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:14.309593 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ed3d0526-9f41-48c3-b2a1-338d30f4067b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:14.310047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ed3d0526-9f41-48c3-b2a1-338d30f4067b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:14.443454 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ed3d0526-9f41-48c3-b2a1-338d30f4067b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:14.451356 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ed3d0526-9f41-48c3-b2a1-338d30f4067b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:14.452873 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ed3d0526-9f41-48c3-b2a1-338d30f4067b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:14.454030 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ed3d0526-9f41-48c3-b2a1-338d30f4067b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1721 microversion: 2.20 time: 0.157753 Jun 16 15:02:14.454575 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 457/912] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:14 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:15.472525 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e30f75ab-8049-4b7f-adcc-94947900a7b6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:15.473121 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e30f75ab-8049-4b7f-adcc-94947900a7b6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:15.480819 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e30f75ab-8049-4b7f-adcc-94947900a7b6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:15.481891 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e30f75ab-8049-4b7f-adcc-94947900a7b6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:15.482833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e30f75ab-8049-4b7f-adcc-94947900a7b6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:15.483366 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e30f75ab-8049-4b7f-adcc-94947900a7b6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:15.619382 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e30f75ab-8049-4b7f-adcc-94947900a7b6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:15.628749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e30f75ab-8049-4b7f-adcc-94947900a7b6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:15.630236 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e30f75ab-8049-4b7f-adcc-94947900a7b6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:15.631386 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e30f75ab-8049-4b7f-adcc-94947900a7b6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1721 microversion: 2.20 time: 0.162814 Jun 16 15:02:15.631965 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 456/913] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:15 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:16.649866 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0ff73818-77ac-4d1b-86a1-d18dfbce4218 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:16.650510 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0ff73818-77ac-4d1b-86a1-d18dfbce4218 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:16.657145 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0ff73818-77ac-4d1b-86a1-d18dfbce4218 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:16.657592 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0ff73818-77ac-4d1b-86a1-d18dfbce4218 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:16.658629 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0ff73818-77ac-4d1b-86a1-d18dfbce4218 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:16.659067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0ff73818-77ac-4d1b-86a1-d18dfbce4218 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:16.804183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0ff73818-77ac-4d1b-86a1-d18dfbce4218 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:16.812875 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0ff73818-77ac-4d1b-86a1-d18dfbce4218 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:16.814406 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0ff73818-77ac-4d1b-86a1-d18dfbce4218 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:16.815578 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0ff73818-77ac-4d1b-86a1-d18dfbce4218 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1721 microversion: 2.20 time: 0.169680 Jun 16 15:02:16.816151 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 458/914] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:16 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:17.833665 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ca7c68ad-b816-4210-8fe2-ab8d47942d10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:17.834249 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ca7c68ad-b816-4210-8fe2-ab8d47942d10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:17.840633 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ca7c68ad-b816-4210-8fe2-ab8d47942d10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:17.841080 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ca7c68ad-b816-4210-8fe2-ab8d47942d10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:17.842345 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ca7c68ad-b816-4210-8fe2-ab8d47942d10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:17.842777 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ca7c68ad-b816-4210-8fe2-ab8d47942d10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:17.985555 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ca7c68ad-b816-4210-8fe2-ab8d47942d10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:17.993826 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ca7c68ad-b816-4210-8fe2-ab8d47942d10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:17.995322 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ca7c68ad-b816-4210-8fe2-ab8d47942d10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:17.996518 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ca7c68ad-b816-4210-8fe2-ab8d47942d10 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1721 microversion: 2.20 time: 0.166730 Jun 16 15:02:17.997065 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 457/915] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:17 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:19.014570 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b1ff6189-fa95-4c5c-83c9-5f00dc651c33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:19.015176 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b1ff6189-fa95-4c5c-83c9-5f00dc651c33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:19.021751 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b1ff6189-fa95-4c5c-83c9-5f00dc651c33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:19.022273 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b1ff6189-fa95-4c5c-83c9-5f00dc651c33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:19.023107 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b1ff6189-fa95-4c5c-83c9-5f00dc651c33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:19.023550 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b1ff6189-fa95-4c5c-83c9-5f00dc651c33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:19.158481 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b1ff6189-fa95-4c5c-83c9-5f00dc651c33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:19.166624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b1ff6189-fa95-4c5c-83c9-5f00dc651c33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:19.168146 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b1ff6189-fa95-4c5c-83c9-5f00dc651c33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:19.169301 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b1ff6189-fa95-4c5c-83c9-5f00dc651c33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1721 microversion: 2.20 time: 0.158640 Jun 16 15:02:19.170604 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 459/916] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:19 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:20.188715 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e8092cf6-8fea-4cbc-8698-4de0e84aa3d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:20.189329 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e8092cf6-8fea-4cbc-8698-4de0e84aa3d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:20.195861 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e8092cf6-8fea-4cbc-8698-4de0e84aa3d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:20.196312 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e8092cf6-8fea-4cbc-8698-4de0e84aa3d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:20.197080 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e8092cf6-8fea-4cbc-8698-4de0e84aa3d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:20.197512 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e8092cf6-8fea-4cbc-8698-4de0e84aa3d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:20.337963 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e8092cf6-8fea-4cbc-8698-4de0e84aa3d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:20.346467 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e8092cf6-8fea-4cbc-8698-4de0e84aa3d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:20.348009 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e8092cf6-8fea-4cbc-8698-4de0e84aa3d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:20.349152 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e8092cf6-8fea-4cbc-8698-4de0e84aa3d1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1721 microversion: 2.20 time: 0.164851 Jun 16 15:02:20.349683 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 458/917] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:20 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:21.366513 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a6c84af8-d1b2-4a05-b6e3-e43535b9c4ec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:21.367124 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a6c84af8-d1b2-4a05-b6e3-e43535b9c4ec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:21.374762 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a6c84af8-d1b2-4a05-b6e3-e43535b9c4ec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:21.375282 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a6c84af8-d1b2-4a05-b6e3-e43535b9c4ec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:21.377989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a6c84af8-d1b2-4a05-b6e3-e43535b9c4ec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:21.377989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a6c84af8-d1b2-4a05-b6e3-e43535b9c4ec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:21.508780 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a6c84af8-d1b2-4a05-b6e3-e43535b9c4ec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:21.516894 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a6c84af8-d1b2-4a05-b6e3-e43535b9c4ec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:21.518394 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a6c84af8-d1b2-4a05-b6e3-e43535b9c4ec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:21.519554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a6c84af8-d1b2-4a05-b6e3-e43535b9c4ec tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1721 microversion: 2.20 time: 0.157002 Jun 16 15:02:21.520137 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 460/918] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:21 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:22.536960 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8e042e13-22fb-4748-b0d4-2f54f3cc1d56 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:22.537565 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-8e042e13-22fb-4748-b0d4-2f54f3cc1d56 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:22.544231 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8e042e13-22fb-4748-b0d4-2f54f3cc1d56 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:22.544701 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8e042e13-22fb-4748-b0d4-2f54f3cc1d56 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:22.545460 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8e042e13-22fb-4748-b0d4-2f54f3cc1d56 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:22.546365 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8e042e13-22fb-4748-b0d4-2f54f3cc1d56 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:22.695046 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-8e042e13-22fb-4748-b0d4-2f54f3cc1d56 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:22.706643 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-8e042e13-22fb-4748-b0d4-2f54f3cc1d56 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:22.708707 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-8e042e13-22fb-4748-b0d4-2f54f3cc1d56 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:22.710556 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8e042e13-22fb-4748-b0d4-2f54f3cc1d56 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1721 microversion: 2.20 time: 0.177590 Jun 16 15:02:22.711108 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 459/919] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:22 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:23.729110 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b98b5808-6aa3-4793-a649-d6c43571c92a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:23.730236 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b98b5808-6aa3-4793-a649-d6c43571c92a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:23.736982 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b98b5808-6aa3-4793-a649-d6c43571c92a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:23.737435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b98b5808-6aa3-4793-a649-d6c43571c92a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:23.738217 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b98b5808-6aa3-4793-a649-d6c43571c92a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:23.738997 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b98b5808-6aa3-4793-a649-d6c43571c92a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:23.879592 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b98b5808-6aa3-4793-a649-d6c43571c92a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:23.887953 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b98b5808-6aa3-4793-a649-d6c43571c92a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:23.890282 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b98b5808-6aa3-4793-a649-d6c43571c92a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:23.891889 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b98b5808-6aa3-4793-a649-d6c43571c92a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1742 microversion: 2.20 time: 0.166201 Jun 16 15:02:23.892558 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 461/920] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:23 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1742 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:24.912236 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d1ae2a6c-010f-4455-a093-3f95dea4366d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:24.912927 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d1ae2a6c-010f-4455-a093-3f95dea4366d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:24.915783 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:24.922242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d1ae2a6c-010f-4455-a093-3f95dea4366d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:24.922492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d1ae2a6c-010f-4455-a093-3f95dea4366d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:24.923161 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d1ae2a6c-010f-4455-a093-3f95dea4366d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:24.923593 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d1ae2a6c-010f-4455-a093-3f95dea4366d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:25.058577 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d1ae2a6c-010f-4455-a093-3f95dea4366d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:25.070227 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d1ae2a6c-010f-4455-a093-3f95dea4366d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:25.070227 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d1ae2a6c-010f-4455-a093-3f95dea4366d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:25.070227 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d1ae2a6c-010f-4455-a093-3f95dea4366d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1742 microversion: 2.20 time: 0.162127 Jun 16 15:02:25.070510 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 460/921] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:24 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:26.088318 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a3ba83d8-333c-42fd-89cd-e5d0359035e4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:26.089547 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a3ba83d8-333c-42fd-89cd-e5d0359035e4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:26.096700 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a3ba83d8-333c-42fd-89cd-e5d0359035e4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:26.097152 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a3ba83d8-333c-42fd-89cd-e5d0359035e4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:26.097949 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a3ba83d8-333c-42fd-89cd-e5d0359035e4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:26.098571 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a3ba83d8-333c-42fd-89cd-e5d0359035e4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:26.261067 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a3ba83d8-333c-42fd-89cd-e5d0359035e4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:26.273490 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a3ba83d8-333c-42fd-89cd-e5d0359035e4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:26.275184 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a3ba83d8-333c-42fd-89cd-e5d0359035e4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:26.276443 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a3ba83d8-333c-42fd-89cd-e5d0359035e4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1737 microversion: 2.20 time: 0.192040 Jun 16 15:02:26.283874 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 462/922] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:26 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:27.297457 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-48cf56de-c6e6-44ed-9ba1-141b2c513701 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:27.298100 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-48cf56de-c6e6-44ed-9ba1-141b2c513701 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:27.306511 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-48cf56de-c6e6-44ed-9ba1-141b2c513701 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:27.307140 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-48cf56de-c6e6-44ed-9ba1-141b2c513701 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:27.308102 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-48cf56de-c6e6-44ed-9ba1-141b2c513701 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:27.308771 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-48cf56de-c6e6-44ed-9ba1-141b2c513701 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:27.477404 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-48cf56de-c6e6-44ed-9ba1-141b2c513701 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:27.488539 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-48cf56de-c6e6-44ed-9ba1-141b2c513701 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:27.490395 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-48cf56de-c6e6-44ed-9ba1-141b2c513701 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:27.491739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-48cf56de-c6e6-44ed-9ba1-141b2c513701 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1737 microversion: 2.20 time: 0.198438 Jun 16 15:02:27.492453 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 461/923] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:27 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:28.511146 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d03653de-db36-460e-9667-55933cc34368 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:28.511821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d03653de-db36-460e-9667-55933cc34368 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:28.515175 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=30 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:28.523178 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d03653de-db36-460e-9667-55933cc34368 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:28.523740 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d03653de-db36-460e-9667-55933cc34368 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:28.524788 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d03653de-db36-460e-9667-55933cc34368 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:28.525459 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d03653de-db36-460e-9667-55933cc34368 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:28.529549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:28.608662 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-92d77128-32c2-4291-9fd6-7b987025d014 req-97a1e191-3a6c-428b-8372-1ac2942195d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c044f7d0-a298-4c42-9a40-2bc494b1cdc9", "name": "network-vif-plugged", "status": "completed", "tag": "ee7ef7f3-bf69-418d-ace6-a422233a0197"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:28.620930 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-92d77128-32c2-4291-9fd6-7b987025d014 req-97a1e191-3a6c-428b-8372-1ac2942195d4 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:28.621649 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-92d77128-32c2-4291-9fd6-7b987025d014 req-97a1e191-3a6c-428b-8372-1ac2942195d4 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:28.640729 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-92d77128-32c2-4291-9fd6-7b987025d014 req-97a1e191-3a6c-428b-8372-1ac2942195d4 service nova] Creating event network-vif-plugged:ee7ef7f3-bf69-418d-ace6-a422233a0197 for instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 on hv-cinder-83716 Jun 16 15:02:28.648008 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-92d77128-32c2-4291-9fd6-7b987025d014 req-97a1e191-3a6c-428b-8372-1ac2942195d4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045370 Jun 16 15:02:28.649827 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 462/924] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:02:28.703370 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d03653de-db36-460e-9667-55933cc34368 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:28.712394 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d03653de-db36-460e-9667-55933cc34368 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:28.714039 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d03653de-db36-460e-9667-55933cc34368 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:28.715782 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d03653de-db36-460e-9667-55933cc34368 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1737 microversion: 2.20 time: 0.208956 Jun 16 15:02:28.726782 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 463/925] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:28 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:29.737431 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-2aa2fdce-b164-4cd3-ab25-789e279fb827 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:29.738964 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-2aa2fdce-b164-4cd3-ab25-789e279fb827 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:29.750188 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2aa2fdce-b164-4cd3-ab25-789e279fb827 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:29.750927 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2aa2fdce-b164-4cd3-ab25-789e279fb827 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:29.752341 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2aa2fdce-b164-4cd3-ab25-789e279fb827 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:29.753956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2aa2fdce-b164-4cd3-ab25-789e279fb827 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:29.943099 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2aa2fdce-b164-4cd3-ab25-789e279fb827 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:29.951993 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2aa2fdce-b164-4cd3-ab25-789e279fb827 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:29.954117 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2aa2fdce-b164-4cd3-ab25-789e279fb827 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:29.955640 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-2aa2fdce-b164-4cd3-ab25-789e279fb827 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1737 microversion: 2.20 time: 0.224790 Jun 16 15:02:29.956221 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 463/926] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:29 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:30.973151 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a6bbcbfa-d421-4405-94d5-61e42959df34 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:30.974535 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a6bbcbfa-d421-4405-94d5-61e42959df34 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:30.981211 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a6bbcbfa-d421-4405-94d5-61e42959df34 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:30.982528 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a6bbcbfa-d421-4405-94d5-61e42959df34 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:30.983288 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a6bbcbfa-d421-4405-94d5-61e42959df34 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:30.983739 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a6bbcbfa-d421-4405-94d5-61e42959df34 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:31.126007 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a6bbcbfa-d421-4405-94d5-61e42959df34 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:31.134955 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a6bbcbfa-d421-4405-94d5-61e42959df34 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:31.136737 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a6bbcbfa-d421-4405-94d5-61e42959df34 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:31.138052 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a6bbcbfa-d421-4405-94d5-61e42959df34 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1737 microversion: 2.20 time: 0.169211 Jun 16 15:02:31.139046 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 464/927] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:30 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:32.159053 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ca65580b-51ec-4e1e-9206-dd8ae43edaa6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:32.159633 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ca65580b-51ec-4e1e-9206-dd8ae43edaa6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:32.166947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ca65580b-51ec-4e1e-9206-dd8ae43edaa6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:32.172506 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ca65580b-51ec-4e1e-9206-dd8ae43edaa6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:32.175277 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ca65580b-51ec-4e1e-9206-dd8ae43edaa6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:32.175913 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ca65580b-51ec-4e1e-9206-dd8ae43edaa6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:32.331886 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:02:32.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Thu Jun 16 15:02:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:02:32.365064 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ca65580b-51ec-4e1e-9206-dd8ae43edaa6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:32.374243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ca65580b-51ec-4e1e-9206-dd8ae43edaa6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:32.376247 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ca65580b-51ec-4e1e-9206-dd8ae43edaa6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:32.378094 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ca65580b-51ec-4e1e-9206-dd8ae43edaa6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1737 microversion: 2.20 time: 0.223202 Jun 16 15:02:32.378750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 464/928] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:32 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:33.405918 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-adc757d5-d4a7-4e52-a9a9-d455f753b3b1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:33.410140 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-adc757d5-d4a7-4e52-a9a9-d455f753b3b1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:33.445783 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-adc757d5-d4a7-4e52-a9a9-d455f753b3b1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:33.451430 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-adc757d5-d4a7-4e52-a9a9-d455f753b3b1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:33.453123 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-adc757d5-d4a7-4e52-a9a9-d455f753b3b1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:33.460642 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-adc757d5-d4a7-4e52-a9a9-d455f753b3b1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:33.699792 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-adc757d5-d4a7-4e52-a9a9-d455f753b3b1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:33.715461 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-adc757d5-d4a7-4e52-a9a9-d455f753b3b1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:33.717435 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-adc757d5-d4a7-4e52-a9a9-d455f753b3b1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:33.718726 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-adc757d5-d4a7-4e52-a9a9-d455f753b3b1 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1737 microversion: 2.20 time: 0.322883 Jun 16 15:02:33.730572 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 465/929] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:33 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1737 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:34.737064 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-dbc03457-1274-4656-961c-2b15490e95c9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:34.738991 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-dbc03457-1274-4656-961c-2b15490e95c9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:34.747180 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dbc03457-1274-4656-961c-2b15490e95c9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:34.748111 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dbc03457-1274-4656-961c-2b15490e95c9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:34.749031 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dbc03457-1274-4656-961c-2b15490e95c9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:34.749638 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dbc03457-1274-4656-961c-2b15490e95c9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:34.949181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-dbc03457-1274-4656-961c-2b15490e95c9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:34.963845 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-dbc03457-1274-4656-961c-2b15490e95c9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:34.965718 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-dbc03457-1274-4656-961c-2b15490e95c9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:34.968258 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-dbc03457-1274-4656-961c-2b15490e95c9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1737 microversion: 2.20 time: 0.235353 Jun 16 15:02:34.969338 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 465/930] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:34 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:35.300508 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-da04e94f-e818-4066-aa3f-b45720b982d3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:35.301967 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-da04e94f-e818-4066-aa3f-b45720b982d3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:35.310041 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-da04e94f-e818-4066-aa3f-b45720b982d3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:35.311052 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-da04e94f-e818-4066-aa3f-b45720b982d3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:35.312388 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-da04e94f-e818-4066-aa3f-b45720b982d3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:35.312989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-da04e94f-e818-4066-aa3f-b45720b982d3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:35.351859 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-da04e94f-e818-4066-aa3f-b45720b982d3 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527/ips" status: 200 len: 150 microversion: 2.1 time: 0.055429 Jun 16 15:02:35.352800 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 466/931] 10.222.0.76 () {58 vars in 1247 bytes} [Thu Jun 16 15:02:35 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527/ips => generated 150 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:35.992032 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-26517cc4-69ee-49b8-8060-11f3bde6fc2a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:35.992639 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-26517cc4-69ee-49b8-8060-11f3bde6fc2a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:35.999953 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-26517cc4-69ee-49b8-8060-11f3bde6fc2a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:36.000403 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-26517cc4-69ee-49b8-8060-11f3bde6fc2a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:36.001166 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-26517cc4-69ee-49b8-8060-11f3bde6fc2a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:36.001600 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-26517cc4-69ee-49b8-8060-11f3bde6fc2a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:36.148584 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-26517cc4-69ee-49b8-8060-11f3bde6fc2a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:36.159251 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-26517cc4-69ee-49b8-8060-11f3bde6fc2a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:36.161223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-26517cc4-69ee-49b8-8060-11f3bde6fc2a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:36.162450 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-26517cc4-69ee-49b8-8060-11f3bde6fc2a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1719 microversion: 2.20 time: 0.174399 Jun 16 15:02:36.163212 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 466/932] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:35 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:36.727310 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-156cc361-5751-480b-9412-52703313b1a5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a2d894e-1e3d-4a66-8159-867c58bf983e"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:36.728454 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-156cc361-5751-480b-9412-52703313b1a5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:36.737244 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-156cc361-5751-480b-9412-52703313b1a5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:36.737703 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-156cc361-5751-480b-9412-52703313b1a5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:36.738469 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-156cc361-5751-480b-9412-52703313b1a5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:36.738899 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-156cc361-5751-480b-9412-52703313b1a5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:37.181303 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-dcc56bff-6b1e-44d0-9e00-a7ffadfcc31e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:37.181893 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-dcc56bff-6b1e-44d0-9e00-a7ffadfcc31e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:37.188403 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dcc56bff-6b1e-44d0-9e00-a7ffadfcc31e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:37.188872 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dcc56bff-6b1e-44d0-9e00-a7ffadfcc31e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:37.189633 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dcc56bff-6b1e-44d0-9e00-a7ffadfcc31e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:37.190070 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dcc56bff-6b1e-44d0-9e00-a7ffadfcc31e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:37.320223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-dcc56bff-6b1e-44d0-9e00-a7ffadfcc31e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:37.328099 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-dcc56bff-6b1e-44d0-9e00-a7ffadfcc31e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:37.329609 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-dcc56bff-6b1e-44d0-9e00-a7ffadfcc31e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:37.330761 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-dcc56bff-6b1e-44d0-9e00-a7ffadfcc31e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1719 microversion: 2.20 time: 0.153375 Jun 16 15:02:37.331374 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 467/933] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:37 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:38.350153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-23a0248c-5251-40e7-b9cd-fb2e23758ae4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:38.350806 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-23a0248c-5251-40e7-b9cd-fb2e23758ae4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:38.357507 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-23a0248c-5251-40e7-b9cd-fb2e23758ae4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:38.357957 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-23a0248c-5251-40e7-b9cd-fb2e23758ae4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:38.358762 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-23a0248c-5251-40e7-b9cd-fb2e23758ae4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:38.359239 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-23a0248c-5251-40e7-b9cd-fb2e23758ae4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:38.441858 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-156cc361-5751-480b-9412-52703313b1a5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "POST /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.718842 Jun 16 15:02:38.447352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 467/934] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Jun 16 15:02:36 2022] POST /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527/os-volume_attachments => generated 194 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:38.539030 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-23a0248c-5251-40e7-b9cd-fb2e23758ae4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:38.549499 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-23a0248c-5251-40e7-b9cd-fb2e23758ae4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:38.551284 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-23a0248c-5251-40e7-b9cd-fb2e23758ae4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:38.552936 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-23a0248c-5251-40e7-b9cd-fb2e23758ae4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1719 microversion: 2.20 time: 0.207287 Jun 16 15:02:38.553825 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 468/935] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:38 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1719 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:39.242960 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-edee7c73-a847-4ac8-9d7d-45bb38f43bb4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:39.243569 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-edee7c73-a847-4ac8-9d7d-45bb38f43bb4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:39.250572 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-edee7c73-a847-4ac8-9d7d-45bb38f43bb4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:39.250950 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-edee7c73-a847-4ac8-9d7d-45bb38f43bb4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:39.251735 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-edee7c73-a847-4ac8-9d7d-45bb38f43bb4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:39.252168 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-edee7c73-a847-4ac8-9d7d-45bb38f43bb4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:39.274144 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-edee7c73-a847-4ac8-9d7d-45bb38f43bb4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lazy-loading 'flavor' on Instance uuid 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:02:39.347817 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-edee7c73-a847-4ac8-9d7d-45bb38f43bb4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "POST /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c/action" status: 202 len: 0 microversion: 2.1 time: 0.109627 Jun 16 15:02:39.348759 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 468/936] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Jun 16 15:02:39 2022] POST /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:02:39.358754 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-744f6510-4def-45c9-b540-398e3b483120 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:39.359372 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-744f6510-4def-45c9-b540-398e3b483120 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:39.366308 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-744f6510-4def-45c9-b540-398e3b483120 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:39.366882 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-744f6510-4def-45c9-b540-398e3b483120 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:39.367793 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-744f6510-4def-45c9-b540-398e3b483120 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:39.368230 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-744f6510-4def-45c9-b540-398e3b483120 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:39.510352 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-744f6510-4def-45c9-b540-398e3b483120 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:39.518190 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-744f6510-4def-45c9-b540-398e3b483120 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1568 microversion: 2.1 time: 0.164325 Jun 16 15:02:39.518761 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 469/937] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:39 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:02:39.581576 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3fbf6bd8-d152-4eb6-9b0e-a6bce03ff2d6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:39.582268 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3fbf6bd8-d152-4eb6-9b0e-a6bce03ff2d6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:39.588807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3fbf6bd8-d152-4eb6-9b0e-a6bce03ff2d6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:39.589248 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3fbf6bd8-d152-4eb6-9b0e-a6bce03ff2d6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:39.590035 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3fbf6bd8-d152-4eb6-9b0e-a6bce03ff2d6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:39.590465 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3fbf6bd8-d152-4eb6-9b0e-a6bce03ff2d6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:39.878995 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3fbf6bd8-d152-4eb6-9b0e-a6bce03ff2d6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:39.887830 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3fbf6bd8-d152-4eb6-9b0e-a6bce03ff2d6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:39.889834 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3fbf6bd8-d152-4eb6-9b0e-a6bce03ff2d6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:39.891123 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3fbf6bd8-d152-4eb6-9b0e-a6bce03ff2d6 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1662 microversion: 2.20 time: 0.313821 Jun 16 15:02:39.891673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 469/938] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:39 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1662 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:39.912111 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7ac37579-9ee8-4718-a968-c6e0e8f943d7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "daa4aa39-5557-4cf3-9c54-cd02fc106c08"}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:39.913315 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7ac37579-9ee8-4718-a968-c6e0e8f943d7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:39.920180 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7ac37579-9ee8-4718-a968-c6e0e8f943d7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:39.920637 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7ac37579-9ee8-4718-a968-c6e0e8f943d7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:39.921438 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7ac37579-9ee8-4718-a968-c6e0e8f943d7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:39.921838 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7ac37579-9ee8-4718-a968-c6e0e8f943d7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:40.099771 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:40.207590 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7ac37579-9ee8-4718-a968-c6e0e8f943d7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "POST /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.302465 Jun 16 15:02:40.208795 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 470/939] 10.222.0.76 () {62 vars in 1363 bytes} [Thu Jun 16 15:02:39 2022] POST /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9/os-volume_attachments => generated 188 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 15:02:40.354172 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-97882a0c-706f-49f2-81e7-af648b92e0a7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:40.354669 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-97882a0c-706f-49f2-81e7-af648b92e0a7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:40.361061 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-97882a0c-706f-49f2-81e7-af648b92e0a7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:40.361513 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-97882a0c-706f-49f2-81e7-af648b92e0a7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:40.362276 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-97882a0c-706f-49f2-81e7-af648b92e0a7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:40.362715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-97882a0c-706f-49f2-81e7-af648b92e0a7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:40.537773 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-182cbeee-450c-4cf4-82af-8a4e44398898 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:40.538285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-182cbeee-450c-4cf4-82af-8a4e44398898 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:40.546731 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-182cbeee-450c-4cf4-82af-8a4e44398898 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:40.547180 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-182cbeee-450c-4cf4-82af-8a4e44398898 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:40.547973 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-182cbeee-450c-4cf4-82af-8a4e44398898 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:40.548515 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-182cbeee-450c-4cf4-82af-8a4e44398898 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:40.705835 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-97882a0c-706f-49f2-81e7-af648b92e0a7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9/os-volume_attachments/daa4aa39-5557-4cf3-9c54-cd02fc106c08" status: 202 len: 0 microversion: 2.20 time: 0.355409 Jun 16 15:02:40.707036 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 470/940] 10.222.0.76 () {60 vars in 1456 bytes} [Thu Jun 16 15:02:40 2022] DELETE /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9/os-volume_attachments/daa4aa39-5557-4cf3-9c54-cd02fc106c08 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:02:40.732363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-54fce0dd-8015-4e37-addb-eb64ed0bcedf req-6525a97d-130d-4d22-a7bb-d8035a83ad81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c044f7d0-a298-4c42-9a40-2bc494b1cdc9", "name": "network-vif-unplugged", "status": "completed", "tag": "ee7ef7f3-bf69-418d-ace6-a422233a0197"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:40.752752 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-54fce0dd-8015-4e37-addb-eb64ed0bcedf req-6525a97d-130d-4d22-a7bb-d8035a83ad81 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:40.753383 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-54fce0dd-8015-4e37-addb-eb64ed0bcedf req-6525a97d-130d-4d22-a7bb-d8035a83ad81 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:40.755882 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-182cbeee-450c-4cf4-82af-8a4e44398898 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:40.765574 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-182cbeee-450c-4cf4-82af-8a4e44398898 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1568 microversion: 2.1 time: 0.232341 Jun 16 15:02:40.766753 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 471/941] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:40 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:02:40.767710 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.compute.server_external_events [req-54fce0dd-8015-4e37-addb-eb64ed0bcedf req-6525a97d-130d-4d22-a7bb-d8035a83ad81 service nova] Unable to find a host for instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9. Dropping event network-vif-unplugged {{(pid=117444) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 15:02:40.768709 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-54fce0dd-8015-4e37-addb-eb64ed0bcedf req-6525a97d-130d-4d22-a7bb-d8035a83ad81 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043754 Jun 16 15:02:40.769752 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 471/942] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 16 15:02:40.776467 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d7c72363-b19e-46b8-89cf-1de5acceb57c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:40.778148 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d7c72363-b19e-46b8-89cf-1de5acceb57c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:40.785361 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d7c72363-b19e-46b8-89cf-1de5acceb57c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:40.785818 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d7c72363-b19e-46b8-89cf-1de5acceb57c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:40.786565 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d7c72363-b19e-46b8-89cf-1de5acceb57c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:40.787169 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d7c72363-b19e-46b8-89cf-1de5acceb57c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:40.886852 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d7c72363-b19e-46b8-89cf-1de5acceb57c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "POST /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9/action" status: 202 len: 0 microversion: 2.20 time: 0.115728 Jun 16 15:02:40.887467 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 472/943] 10.222.0.76 () {62 vars in 1318 bytes} [Thu Jun 16 15:02:40 2022] POST /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:02:40.896131 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d65d5001-a742-4c9c-a7b8-0e94bab53a33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:40.896760 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d65d5001-a742-4c9c-a7b8-0e94bab53a33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:40.903504 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d65d5001-a742-4c9c-a7b8-0e94bab53a33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:40.904569 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d65d5001-a742-4c9c-a7b8-0e94bab53a33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:40.905323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d65d5001-a742-4c9c-a7b8-0e94bab53a33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:40.906206 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d65d5001-a742-4c9c-a7b8-0e94bab53a33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:41.098153 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d65d5001-a742-4c9c-a7b8-0e94bab53a33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:41.106359 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d65d5001-a742-4c9c-a7b8-0e94bab53a33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:41.108856 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d65d5001-a742-4c9c-a7b8-0e94bab53a33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:41.110157 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d65d5001-a742-4c9c-a7b8-0e94bab53a33 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1670 microversion: 2.20 time: 0.218581 Jun 16 15:02:41.111187 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 472/944] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:40 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1670 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:41.783341 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-eb389727-2ed2-43f9-9850-464c07b94948 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:41.784653 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-eb389727-2ed2-43f9-9850-464c07b94948 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:41.791609 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-eb389727-2ed2-43f9-9850-464c07b94948 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:41.792108 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-eb389727-2ed2-43f9-9850-464c07b94948 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:41.793026 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-eb389727-2ed2-43f9-9850-464c07b94948 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:41.793474 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-eb389727-2ed2-43f9-9850-464c07b94948 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:41.946970 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-eb389727-2ed2-43f9-9850-464c07b94948 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:41.958442 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-eb389727-2ed2-43f9-9850-464c07b94948 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1568 microversion: 2.1 time: 0.179900 Jun 16 15:02:41.959125 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 473/945] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:41 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:42.129923 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ac4ebd6b-c2db-44d1-97ea-3b0ea846a99e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:42.130908 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ac4ebd6b-c2db-44d1-97ea-3b0ea846a99e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:42.137849 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ac4ebd6b-c2db-44d1-97ea-3b0ea846a99e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:42.139063 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ac4ebd6b-c2db-44d1-97ea-3b0ea846a99e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:42.139976 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ac4ebd6b-c2db-44d1-97ea-3b0ea846a99e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:42.141103 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ac4ebd6b-c2db-44d1-97ea-3b0ea846a99e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:42.313730 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ac4ebd6b-c2db-44d1-97ea-3b0ea846a99e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:42.321945 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ac4ebd6b-c2db-44d1-97ea-3b0ea846a99e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:42.323510 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ac4ebd6b-c2db-44d1-97ea-3b0ea846a99e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:42.324647 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ac4ebd6b-c2db-44d1-97ea-3b0ea846a99e tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1670 microversion: 2.20 time: 0.199012 Jun 16 15:02:42.325196 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 473/946] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:42 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1670 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:42.976045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-cd00ce4f-89b6-430c-b156-659238718ab6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:42.976646 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-cd00ce4f-89b6-430c-b156-659238718ab6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:42.983782 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-cd00ce4f-89b6-430c-b156-659238718ab6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:42.984267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-cd00ce4f-89b6-430c-b156-659238718ab6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:42.985162 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-cd00ce4f-89b6-430c-b156-659238718ab6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:42.985609 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-cd00ce4f-89b6-430c-b156-659238718ab6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:43.130303 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-cd00ce4f-89b6-430c-b156-659238718ab6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:43.139170 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-cd00ce4f-89b6-430c-b156-659238718ab6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1568 microversion: 2.1 time: 0.166887 Jun 16 15:02:43.140018 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 474/947] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:42 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:43.346692 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-efa42d4a-fe15-467a-b328-b9eabf59ed7c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:43.347306 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-efa42d4a-fe15-467a-b328-b9eabf59ed7c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:43.355149 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-efa42d4a-fe15-467a-b328-b9eabf59ed7c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:43.355553 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-efa42d4a-fe15-467a-b328-b9eabf59ed7c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:43.356357 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-efa42d4a-fe15-467a-b328-b9eabf59ed7c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:43.357338 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-efa42d4a-fe15-467a-b328-b9eabf59ed7c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:43.504584 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-efa42d4a-fe15-467a-b328-b9eabf59ed7c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:43.508158 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:43.514336 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-efa42d4a-fe15-467a-b328-b9eabf59ed7c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:43.515907 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-efa42d4a-fe15-467a-b328-b9eabf59ed7c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:43.517084 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-efa42d4a-fe15-467a-b328-b9eabf59ed7c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.175879 Jun 16 15:02:43.517791 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 474/948] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:43 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:44.159195 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-98a5f0e4-5ba5-4736-9324-bb3bbd7afd8c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:44.160731 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-98a5f0e4-5ba5-4736-9324-bb3bbd7afd8c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:44.170334 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-98a5f0e4-5ba5-4736-9324-bb3bbd7afd8c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:44.171392 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-98a5f0e4-5ba5-4736-9324-bb3bbd7afd8c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:44.173352 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-98a5f0e4-5ba5-4736-9324-bb3bbd7afd8c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:44.174190 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-98a5f0e4-5ba5-4736-9324-bb3bbd7afd8c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:44.415799 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-98a5f0e4-5ba5-4736-9324-bb3bbd7afd8c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:44.427208 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-98a5f0e4-5ba5-4736-9324-bb3bbd7afd8c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1568 microversion: 2.1 time: 0.273402 Jun 16 15:02:44.428121 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 475/949] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:44 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1568 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:44.539016 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-91a79ec8-325c-4702-abf1-2b09f29b38cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:44.539660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-91a79ec8-325c-4702-abf1-2b09f29b38cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:44.548376 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-91a79ec8-325c-4702-abf1-2b09f29b38cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:44.548866 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-91a79ec8-325c-4702-abf1-2b09f29b38cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:44.549662 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-91a79ec8-325c-4702-abf1-2b09f29b38cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:44.550107 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-91a79ec8-325c-4702-abf1-2b09f29b38cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:44.719052 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-91a79ec8-325c-4702-abf1-2b09f29b38cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:44.728037 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-91a79ec8-325c-4702-abf1-2b09f29b38cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:44.729864 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-91a79ec8-325c-4702-abf1-2b09f29b38cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:44.731079 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-91a79ec8-325c-4702-abf1-2b09f29b38cb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.196407 Jun 16 15:02:44.731661 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 475/950] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:44 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:45.445168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-79bbd378-8cde-4487-978a-ba8a04d3001d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:45.445783 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-79bbd378-8cde-4487-978a-ba8a04d3001d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:45.453260 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-79bbd378-8cde-4487-978a-ba8a04d3001d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:45.453948 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-79bbd378-8cde-4487-978a-ba8a04d3001d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:45.454711 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-79bbd378-8cde-4487-978a-ba8a04d3001d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:45.455140 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-79bbd378-8cde-4487-978a-ba8a04d3001d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:45.616381 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-79bbd378-8cde-4487-978a-ba8a04d3001d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:45.628432 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-79bbd378-8cde-4487-978a-ba8a04d3001d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1568 microversion: 2.1 time: 0.187036 Jun 16 15:02:45.629044 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 476/951] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:45 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:45.760332 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-23f12e90-2d28-4478-9d90-1959f6902288 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:45.761597 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-23f12e90-2d28-4478-9d90-1959f6902288 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:45.775082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-23f12e90-2d28-4478-9d90-1959f6902288 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:45.776663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-23f12e90-2d28-4478-9d90-1959f6902288 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:45.778702 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-23f12e90-2d28-4478-9d90-1959f6902288 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:45.780783 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-23f12e90-2d28-4478-9d90-1959f6902288 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:45.951412 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-23f12e90-2d28-4478-9d90-1959f6902288 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:45.962549 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-23f12e90-2d28-4478-9d90-1959f6902288 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:45.964096 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-23f12e90-2d28-4478-9d90-1959f6902288 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:45.965354 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-23f12e90-2d28-4478-9d90-1959f6902288 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.213932 Jun 16 15:02:45.966109 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 476/952] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:45 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:46.646064 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-bbacb743-15c1-447c-8f16-298ca56f5dad tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:46.646963 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-bbacb743-15c1-447c-8f16-298ca56f5dad tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:46.658328 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bbacb743-15c1-447c-8f16-298ca56f5dad tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:46.659210 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bbacb743-15c1-447c-8f16-298ca56f5dad tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:46.660059 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bbacb743-15c1-447c-8f16-298ca56f5dad tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:46.660465 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-bbacb743-15c1-447c-8f16-298ca56f5dad tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:46.842025 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-bbacb743-15c1-447c-8f16-298ca56f5dad tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:46.853721 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-bbacb743-15c1-447c-8f16-298ca56f5dad tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1568 microversion: 2.1 time: 0.211951 Jun 16 15:02:46.854347 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 477/953] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:46 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:46.986334 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-55da69f0-da2a-4ca0-925b-72183c242c7f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:46.986873 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-55da69f0-da2a-4ca0-925b-72183c242c7f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:46.995169 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-55da69f0-da2a-4ca0-925b-72183c242c7f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:46.998468 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-55da69f0-da2a-4ca0-925b-72183c242c7f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:46.999333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-55da69f0-da2a-4ca0-925b-72183c242c7f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:46.999813 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-55da69f0-da2a-4ca0-925b-72183c242c7f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:47.190283 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-55da69f0-da2a-4ca0-925b-72183c242c7f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:47.200043 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-55da69f0-da2a-4ca0-925b-72183c242c7f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:47.202191 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-55da69f0-da2a-4ca0-925b-72183c242c7f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:47.203473 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-55da69f0-da2a-4ca0-925b-72183c242c7f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.222511 Jun 16 15:02:47.214594 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 477/954] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:46 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:47.871640 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-23914748-2f07-48f1-8849-0142a6a032bf tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:47.874637 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-23914748-2f07-48f1-8849-0142a6a032bf tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:47.881043 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-23914748-2f07-48f1-8849-0142a6a032bf tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:47.881494 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-23914748-2f07-48f1-8849-0142a6a032bf tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:47.882314 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-23914748-2f07-48f1-8849-0142a6a032bf tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:47.883115 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-23914748-2f07-48f1-8849-0142a6a032bf tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:48.031736 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-23914748-2f07-48f1-8849-0142a6a032bf tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:48.039712 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-23914748-2f07-48f1-8849-0142a6a032bf tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1568 microversion: 2.1 time: 0.172474 Jun 16 15:02:48.040276 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 478/955] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:47 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:48.223472 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0d138f93-29dd-4089-9a64-5bd98b389ed7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:48.224150 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0d138f93-29dd-4089-9a64-5bd98b389ed7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:48.231824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0d138f93-29dd-4089-9a64-5bd98b389ed7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:48.232308 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0d138f93-29dd-4089-9a64-5bd98b389ed7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:48.233178 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0d138f93-29dd-4089-9a64-5bd98b389ed7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:48.233706 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0d138f93-29dd-4089-9a64-5bd98b389ed7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:48.394123 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0d138f93-29dd-4089-9a64-5bd98b389ed7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:48.403908 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0d138f93-29dd-4089-9a64-5bd98b389ed7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:48.405943 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0d138f93-29dd-4089-9a64-5bd98b389ed7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:48.407090 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0d138f93-29dd-4089-9a64-5bd98b389ed7 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.188035 Jun 16 15:02:48.408868 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 478/956] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:48 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:49.058500 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-258886c1-71c2-42ef-8a45-c9f777dc2560 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:49.059250 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-258886c1-71c2-42ef-8a45-c9f777dc2560 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:49.066945 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-258886c1-71c2-42ef-8a45-c9f777dc2560 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:49.067395 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-258886c1-71c2-42ef-8a45-c9f777dc2560 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:49.068195 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-258886c1-71c2-42ef-8a45-c9f777dc2560 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:49.068621 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-258886c1-71c2-42ef-8a45-c9f777dc2560 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:49.240931 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-258886c1-71c2-42ef-8a45-c9f777dc2560 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:49.248965 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-258886c1-71c2-42ef-8a45-c9f777dc2560 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1568 microversion: 2.1 time: 0.194159 Jun 16 15:02:49.250102 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 479/957] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:49 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:49.429683 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cc143d3c-b429-4f3d-8a11-60efcebc0699 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:49.430932 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-cc143d3c-b429-4f3d-8a11-60efcebc0699 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:49.439070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc143d3c-b429-4f3d-8a11-60efcebc0699 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:49.439523 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc143d3c-b429-4f3d-8a11-60efcebc0699 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:49.440430 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc143d3c-b429-4f3d-8a11-60efcebc0699 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:49.440937 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc143d3c-b429-4f3d-8a11-60efcebc0699 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:49.593021 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cc143d3c-b429-4f3d-8a11-60efcebc0699 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:49.601411 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cc143d3c-b429-4f3d-8a11-60efcebc0699 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:49.602912 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cc143d3c-b429-4f3d-8a11-60efcebc0699 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:49.604110 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-cc143d3c-b429-4f3d-8a11-60efcebc0699 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.181212 Jun 16 15:02:49.604849 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 479/958] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:49 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:50.268002 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-cb70e30b-d3fc-428e-aa0b-464a8b9d3ec5 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:50.268932 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-cb70e30b-d3fc-428e-aa0b-464a8b9d3ec5 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:50.279982 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-cb70e30b-d3fc-428e-aa0b-464a8b9d3ec5 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:50.280465 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-cb70e30b-d3fc-428e-aa0b-464a8b9d3ec5 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:50.281283 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-cb70e30b-d3fc-428e-aa0b-464a8b9d3ec5 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:50.281711 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-cb70e30b-d3fc-428e-aa0b-464a8b9d3ec5 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:50.439994 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-cb70e30b-d3fc-428e-aa0b-464a8b9d3ec5 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:50.447531 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-cb70e30b-d3fc-428e-aa0b-464a8b9d3ec5 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1568 microversion: 2.1 time: 0.184641 Jun 16 15:02:50.448311 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 480/959] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:50 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:50.623530 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9506d63c-fe98-427c-8490-96da10db503d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:50.624310 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9506d63c-fe98-427c-8490-96da10db503d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:50.633122 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9506d63c-fe98-427c-8490-96da10db503d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:50.633782 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9506d63c-fe98-427c-8490-96da10db503d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:50.634571 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9506d63c-fe98-427c-8490-96da10db503d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:50.635013 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9506d63c-fe98-427c-8490-96da10db503d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:50.801406 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9506d63c-fe98-427c-8490-96da10db503d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:50.810265 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9506d63c-fe98-427c-8490-96da10db503d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:50.811818 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9506d63c-fe98-427c-8490-96da10db503d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:50.813047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9506d63c-fe98-427c-8490-96da10db503d tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.194479 Jun 16 15:02:50.813551 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 480/960] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:50 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:51.466660 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-cf8aa003-b2ae-4c50-9f7e-e41c0ce5371e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:51.467275 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-cf8aa003-b2ae-4c50-9f7e-e41c0ce5371e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:51.474010 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-cf8aa003-b2ae-4c50-9f7e-e41c0ce5371e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:51.474635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-cf8aa003-b2ae-4c50-9f7e-e41c0ce5371e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:51.475417 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-cf8aa003-b2ae-4c50-9f7e-e41c0ce5371e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:51.475890 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-cf8aa003-b2ae-4c50-9f7e-e41c0ce5371e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:51.631812 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-cf8aa003-b2ae-4c50-9f7e-e41c0ce5371e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:51.641487 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-cf8aa003-b2ae-4c50-9f7e-e41c0ce5371e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1568 microversion: 2.1 time: 0.179124 Jun 16 15:02:51.642176 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 481/961] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:51 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:51.831638 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-11d9222f-1e3d-4330-a12f-23a496c7d918 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:51.832232 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-11d9222f-1e3d-4330-a12f-23a496c7d918 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:51.839203 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-11d9222f-1e3d-4330-a12f-23a496c7d918 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:51.839673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-11d9222f-1e3d-4330-a12f-23a496c7d918 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:51.840582 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-11d9222f-1e3d-4330-a12f-23a496c7d918 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:51.841082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-11d9222f-1e3d-4330-a12f-23a496c7d918 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:51.986137 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-11d9222f-1e3d-4330-a12f-23a496c7d918 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:51.995141 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-11d9222f-1e3d-4330-a12f-23a496c7d918 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:51.996751 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-11d9222f-1e3d-4330-a12f-23a496c7d918 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:51.998544 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-11d9222f-1e3d-4330-a12f-23a496c7d918 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.171312 Jun 16 15:02:51.999124 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 481/962] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:51 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:52.659666 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7e799648-5a49-4c0b-90e1-6e7f80e93b1c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:52.660225 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7e799648-5a49-4c0b-90e1-6e7f80e93b1c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:52.666788 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e799648-5a49-4c0b-90e1-6e7f80e93b1c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:52.667242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e799648-5a49-4c0b-90e1-6e7f80e93b1c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:52.668042 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e799648-5a49-4c0b-90e1-6e7f80e93b1c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:52.668483 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7e799648-5a49-4c0b-90e1-6e7f80e93b1c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:52.800363 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-7e799648-5a49-4c0b-90e1-6e7f80e93b1c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:52.807832 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7e799648-5a49-4c0b-90e1-6e7f80e93b1c tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1568 microversion: 2.1 time: 0.152351 Jun 16 15:02:52.808463 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 482/963] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:52 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:53.016745 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e836d05d-d7fe-464a-8d3f-bf15d2327f95 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:53.017379 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e836d05d-d7fe-464a-8d3f-bf15d2327f95 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:53.023975 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e836d05d-d7fe-464a-8d3f-bf15d2327f95 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:53.024422 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e836d05d-d7fe-464a-8d3f-bf15d2327f95 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:53.025184 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e836d05d-d7fe-464a-8d3f-bf15d2327f95 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:53.025645 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e836d05d-d7fe-464a-8d3f-bf15d2327f95 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:53.157940 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e836d05d-d7fe-464a-8d3f-bf15d2327f95 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:53.166110 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e836d05d-d7fe-464a-8d3f-bf15d2327f95 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:53.167622 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e836d05d-d7fe-464a-8d3f-bf15d2327f95 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:53.168832 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e836d05d-d7fe-464a-8d3f-bf15d2327f95 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.156036 Jun 16 15:02:53.169961 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 482/964] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:53 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:53.825955 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4cd096ff-bc21-47b2-826e-b3f21280ab23 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:53.826558 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4cd096ff-bc21-47b2-826e-b3f21280ab23 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:53.833037 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4cd096ff-bc21-47b2-826e-b3f21280ab23 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:53.833487 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4cd096ff-bc21-47b2-826e-b3f21280ab23 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:53.834236 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4cd096ff-bc21-47b2-826e-b3f21280ab23 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:53.834666 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4cd096ff-bc21-47b2-826e-b3f21280ab23 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:53.968157 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4cd096ff-bc21-47b2-826e-b3f21280ab23 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:53.975822 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4cd096ff-bc21-47b2-826e-b3f21280ab23 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1568 microversion: 2.1 time: 0.154323 Jun 16 15:02:53.976393 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 483/965] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:53 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:54.188140 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9726e573-a08c-47a4-97ee-b0c51fe0a711 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:54.188754 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9726e573-a08c-47a4-97ee-b0c51fe0a711 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:54.195158 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9726e573-a08c-47a4-97ee-b0c51fe0a711 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:54.195644 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9726e573-a08c-47a4-97ee-b0c51fe0a711 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:54.196776 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9726e573-a08c-47a4-97ee-b0c51fe0a711 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:54.197222 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9726e573-a08c-47a4-97ee-b0c51fe0a711 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:54.325151 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9726e573-a08c-47a4-97ee-b0c51fe0a711 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:54.333003 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9726e573-a08c-47a4-97ee-b0c51fe0a711 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:54.334554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9726e573-a08c-47a4-97ee-b0c51fe0a711 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:54.335705 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9726e573-a08c-47a4-97ee-b0c51fe0a711 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.152242 Jun 16 15:02:54.336255 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 483/966] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:54 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:54.993470 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ae4a1a43-e351-433f-96b1-0983273c4694 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:54.994074 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ae4a1a43-e351-433f-96b1-0983273c4694 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:54.996497 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=50 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:55.002770 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ae4a1a43-e351-433f-96b1-0983273c4694 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:55.003222 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ae4a1a43-e351-433f-96b1-0983273c4694 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:55.004026 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ae4a1a43-e351-433f-96b1-0983273c4694 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:55.004465 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ae4a1a43-e351-433f-96b1-0983273c4694 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:55.137269 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ae4a1a43-e351-433f-96b1-0983273c4694 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:55.145442 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ae4a1a43-e351-433f-96b1-0983273c4694 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1568 microversion: 2.1 time: 0.155988 Jun 16 15:02:55.146018 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 484/967] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:54 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:55.354679 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9379ca29-336f-4caa-a71a-6c4d76280b72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:55.355240 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9379ca29-336f-4caa-a71a-6c4d76280b72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:55.362607 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9379ca29-336f-4caa-a71a-6c4d76280b72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:55.363053 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9379ca29-336f-4caa-a71a-6c4d76280b72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:55.363880 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9379ca29-336f-4caa-a71a-6c4d76280b72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:55.364311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9379ca29-336f-4caa-a71a-6c4d76280b72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:55.501762 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9379ca29-336f-4caa-a71a-6c4d76280b72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:55.509968 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9379ca29-336f-4caa-a71a-6c4d76280b72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:55.511464 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9379ca29-336f-4caa-a71a-6c4d76280b72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:55.513158 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9379ca29-336f-4caa-a71a-6c4d76280b72 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.162067 Jun 16 15:02:55.513743 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 484/968] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:55 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:55.755281 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-0e748aa4-2263-48dd-bda8-e9b7438bd899 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:55.755798 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-0e748aa4-2263-48dd-bda8-e9b7438bd899 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:55.761876 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0e748aa4-2263-48dd-bda8-e9b7438bd899 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:55.763130 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0e748aa4-2263-48dd-bda8-e9b7438bd899 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:55.763563 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0e748aa4-2263-48dd-bda8-e9b7438bd899 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:55.764019 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0e748aa4-2263-48dd-bda8-e9b7438bd899 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:55.766874 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:55.845003 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.objects.instance [None req-0e748aa4-2263-48dd-bda8-e9b7438bd899 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lazy-loading 'services' on Instance uuid ba216f58-575e-4ed9-a34c-1150c21bd527 {{(pid=117443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:02:55.916768 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-0e748aa4-2263-48dd-bda8-e9b7438bd899 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527/os-volume_attachments/6a2d894e-1e3d-4a66-8159-867c58bf983e" status: 202 len: 0 microversion: 2.1 time: 0.165181 Jun 16 15:02:55.917339 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 485/969] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Jun 16 15:02:55 2022] DELETE /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527/os-volume_attachments/6a2d894e-1e3d-4a66-8159-867c58bf983e => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:02:55.925618 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-25b17780-e9e1-4588-af8e-e367b3087fbd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:55.926547 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-25b17780-e9e1-4588-af8e-e367b3087fbd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:55.932648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-25b17780-e9e1-4588-af8e-e367b3087fbd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:55.933108 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-25b17780-e9e1-4588-af8e-e367b3087fbd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:55.933880 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-25b17780-e9e1-4588-af8e-e367b3087fbd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:55.934321 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-25b17780-e9e1-4588-af8e-e367b3087fbd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:55.965365 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-25b17780-e9e1-4588-af8e-e367b3087fbd tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043613 Jun 16 15:02:55.965957 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 485/970] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:02:55 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:56.163737 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-922d4d4e-d0cd-449d-b57c-0bda0ac77a2d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:56.164355 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-922d4d4e-d0cd-449d-b57c-0bda0ac77a2d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:56.170517 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-922d4d4e-d0cd-449d-b57c-0bda0ac77a2d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:56.171118 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-922d4d4e-d0cd-449d-b57c-0bda0ac77a2d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:56.171913 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-922d4d4e-d0cd-449d-b57c-0bda0ac77a2d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:56.172343 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-922d4d4e-d0cd-449d-b57c-0bda0ac77a2d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:56.302621 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-922d4d4e-d0cd-449d-b57c-0bda0ac77a2d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:56.310800 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-922d4d4e-d0cd-449d-b57c-0bda0ac77a2d tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1568 microversion: 2.1 time: 0.151862 Jun 16 15:02:56.311360 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 486/971] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:56 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:56.531660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c3c7ea94-2a70-4250-8889-586658c2d293 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:56.532341 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c3c7ea94-2a70-4250-8889-586658c2d293 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:56.538963 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c3c7ea94-2a70-4250-8889-586658c2d293 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:56.539404 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c3c7ea94-2a70-4250-8889-586658c2d293 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:56.540201 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c3c7ea94-2a70-4250-8889-586658c2d293 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:56.540626 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c3c7ea94-2a70-4250-8889-586658c2d293 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:56.685854 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c3c7ea94-2a70-4250-8889-586658c2d293 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:56.698119 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c3c7ea94-2a70-4250-8889-586658c2d293 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:56.699861 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c3c7ea94-2a70-4250-8889-586658c2d293 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:56.701165 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c3c7ea94-2a70-4250-8889-586658c2d293 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.173473 Jun 16 15:02:56.701757 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 486/972] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:56 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:56.976512 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-093ad77f-860c-4e6b-ab67-1e95cfbb75b1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:56.977512 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-093ad77f-860c-4e6b-ab67-1e95cfbb75b1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:56.983859 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-093ad77f-860c-4e6b-ab67-1e95cfbb75b1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:56.984328 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-093ad77f-860c-4e6b-ab67-1e95cfbb75b1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:56.985065 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-093ad77f-860c-4e6b-ab67-1e95cfbb75b1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:56.986058 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-093ad77f-860c-4e6b-ab67-1e95cfbb75b1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:57.017568 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-093ad77f-860c-4e6b-ab67-1e95cfbb75b1 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 Jun 16 15:02:57.018123 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 487/973] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:02:56 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:57.329029 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1344167c-97d5-4f93-9d42-a360c8e45df7 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:57.329640 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1344167c-97d5-4f93-9d42-a360c8e45df7 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:57.337747 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1344167c-97d5-4f93-9d42-a360c8e45df7 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:57.338194 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1344167c-97d5-4f93-9d42-a360c8e45df7 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:57.339146 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1344167c-97d5-4f93-9d42-a360c8e45df7 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:57.339412 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1344167c-97d5-4f93-9d42-a360c8e45df7 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:57.478976 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1344167c-97d5-4f93-9d42-a360c8e45df7 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:57.486835 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1344167c-97d5-4f93-9d42-a360c8e45df7 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1568 microversion: 2.1 time: 0.162297 Jun 16 15:02:57.487492 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 487/974] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:57 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:57.720743 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-fee6e15a-f7c5-4df9-8922-136f7f685005 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:57.721351 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-fee6e15a-f7c5-4df9-8922-136f7f685005 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:57.727752 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fee6e15a-f7c5-4df9-8922-136f7f685005 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:57.728207 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fee6e15a-f7c5-4df9-8922-136f7f685005 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:57.728963 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fee6e15a-f7c5-4df9-8922-136f7f685005 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:57.729399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fee6e15a-f7c5-4df9-8922-136f7f685005 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:57.861561 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fee6e15a-f7c5-4df9-8922-136f7f685005 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:57.869500 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fee6e15a-f7c5-4df9-8922-136f7f685005 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:57.871004 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fee6e15a-f7c5-4df9-8922-136f7f685005 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:57.872720 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-fee6e15a-f7c5-4df9-8922-136f7f685005 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.155505 Jun 16 15:02:57.873300 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 488/975] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:57 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:58.029672 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ca53a6d2-8b97-4a40-b8f9-f88294e06494 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:58.030529 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ca53a6d2-8b97-4a40-b8f9-f88294e06494 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:58.037192 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca53a6d2-8b97-4a40-b8f9-f88294e06494 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:58.037648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca53a6d2-8b97-4a40-b8f9-f88294e06494 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:58.038414 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca53a6d2-8b97-4a40-b8f9-f88294e06494 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:58.038852 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca53a6d2-8b97-4a40-b8f9-f88294e06494 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:58.070322 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ca53a6d2-8b97-4a40-b8f9-f88294e06494 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044715 Jun 16 15:02:58.070890 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 488/976] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:02:58 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:58.504469 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b253c2e4-ddca-4198-84c3-4adec569f777 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:58.505067 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b253c2e4-ddca-4198-84c3-4adec569f777 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:58.511117 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b253c2e4-ddca-4198-84c3-4adec569f777 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:58.511591 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b253c2e4-ddca-4198-84c3-4adec569f777 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:58.512372 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b253c2e4-ddca-4198-84c3-4adec569f777 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:58.513297 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b253c2e4-ddca-4198-84c3-4adec569f777 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:58.641344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b253c2e4-ddca-4198-84c3-4adec569f777 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:58.651203 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b253c2e4-ddca-4198-84c3-4adec569f777 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1569 microversion: 2.1 time: 0.150206 Jun 16 15:02:58.652285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 489/977] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:58 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:58.672764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3e1792b5-2129-4927-9d7f-324f1f6d634b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:58.673342 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3e1792b5-2129-4927-9d7f-324f1f6d634b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:58.676263 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=52 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:58.680671 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e1792b5-2129-4927-9d7f-324f1f6d634b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:58.681212 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e1792b5-2129-4927-9d7f-324f1f6d634b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:58.681988 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e1792b5-2129-4927-9d7f-324f1f6d634b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:58.682427 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e1792b5-2129-4927-9d7f-324f1f6d634b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:58.758183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3e1792b5-2129-4927-9d7f-324f1f6d634b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "POST /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c/action" status: 202 len: 0 microversion: 2.1 time: 0.090196 Jun 16 15:02:58.758686 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 489/978] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Jun 16 15:02:58 2022] POST /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:02:58.768444 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-39eb98a1-54d1-47a7-aeef-fafb2f537618 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:58.769055 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-39eb98a1-54d1-47a7-aeef-fafb2f537618 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:58.775205 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-39eb98a1-54d1-47a7-aeef-fafb2f537618 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:58.775645 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-39eb98a1-54d1-47a7-aeef-fafb2f537618 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:58.777026 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-39eb98a1-54d1-47a7-aeef-fafb2f537618 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:58.777522 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-39eb98a1-54d1-47a7-aeef-fafb2f537618 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:58.891005 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a780a471-82e6-44f7-926f-bf653eb0cbbb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:58.892436 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a780a471-82e6-44f7-926f-bf653eb0cbbb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:58.898760 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a780a471-82e6-44f7-926f-bf653eb0cbbb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:58.899210 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a780a471-82e6-44f7-926f-bf653eb0cbbb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:58.900032 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a780a471-82e6-44f7-926f-bf653eb0cbbb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:58.900485 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a780a471-82e6-44f7-926f-bf653eb0cbbb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:58.913825 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-39eb98a1-54d1-47a7-aeef-fafb2f537618 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:58.919433 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:58.928361 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-39eb98a1-54d1-47a7-aeef-fafb2f537618 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1577 microversion: 2.1 time: 0.164462 Jun 16 15:02:58.928958 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 490/979] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:58 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:59.047959 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a780a471-82e6-44f7-926f-bf653eb0cbbb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:59.056324 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a780a471-82e6-44f7-926f-bf653eb0cbbb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:59.058075 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a780a471-82e6-44f7-926f-bf653eb0cbbb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:59.059235 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a780a471-82e6-44f7-926f-bf653eb0cbbb tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.172708 Jun 16 15:02:59.060355 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 490/980] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:58 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:59.083248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3c5cfa46-7e24-44ad-9060-b876b87fdd74 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:59.084343 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-3c5cfa46-7e24-44ad-9060-b876b87fdd74 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:59.091538 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3c5cfa46-7e24-44ad-9060-b876b87fdd74 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:59.091862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3c5cfa46-7e24-44ad-9060-b876b87fdd74 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:59.092617 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3c5cfa46-7e24-44ad-9060-b876b87fdd74 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:59.093197 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3c5cfa46-7e24-44ad-9060-b876b87fdd74 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:59.125262 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3c5cfa46-7e24-44ad-9060-b876b87fdd74 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045922 Jun 16 15:02:59.126323 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 491/981] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:02:59 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 15:02:59.187882 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5c7280b6-c03e-46bd-944d-164252094a0c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:59.188378 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5c7280b6-c03e-46bd-944d-164252094a0c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:59.194310 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5c7280b6-c03e-46bd-944d-164252094a0c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:59.194754 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5c7280b6-c03e-46bd-944d-164252094a0c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:59.195528 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5c7280b6-c03e-46bd-944d-164252094a0c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:59.195968 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5c7280b6-c03e-46bd-944d-164252094a0c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:59.221292 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5c7280b6-c03e-46bd-944d-164252094a0c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:02:59.294754 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5c7280b6-c03e-46bd-944d-164252094a0c tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 204 len: 0 microversion: 2.1 time: 0.110579 Jun 16 15:02:59.295248 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 491/982] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:02:59 2022] DELETE /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:02:59.303318 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d0ea0e51-cafb-4d52-9130-24ce565b4348 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:59.303954 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d0ea0e51-cafb-4d52-9130-24ce565b4348 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:59.310415 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d0ea0e51-cafb-4d52-9130-24ce565b4348 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:59.310860 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d0ea0e51-cafb-4d52-9130-24ce565b4348 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:59.311601 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d0ea0e51-cafb-4d52-9130-24ce565b4348 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:59.312192 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d0ea0e51-cafb-4d52-9130-24ce565b4348 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:59.439311 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d0ea0e51-cafb-4d52-9130-24ce565b4348 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:59.446905 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d0ea0e51-cafb-4d52-9130-24ce565b4348 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1682 microversion: 2.1 time: 0.147335 Jun 16 15:02:59.447464 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 492/983] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:59 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:59.946713 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-495f8bf3-2bdc-4c81-9789-b2b07a98ea77 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:59.947323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-495f8bf3-2bdc-4c81-9789-b2b07a98ea77 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:59.954547 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-495f8bf3-2bdc-4c81-9789-b2b07a98ea77 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:59.954991 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-495f8bf3-2bdc-4c81-9789-b2b07a98ea77 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:59.955779 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-495f8bf3-2bdc-4c81-9789-b2b07a98ea77 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:59.956485 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-495f8bf3-2bdc-4c81-9789-b2b07a98ea77 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:00.079039 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6eeb4c04-349f-4514-a13e-90b15d4cc27a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:00.079783 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6eeb4c04-349f-4514-a13e-90b15d4cc27a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:00.086496 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6eeb4c04-349f-4514-a13e-90b15d4cc27a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:00.086952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6eeb4c04-349f-4514-a13e-90b15d4cc27a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:00.087734 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6eeb4c04-349f-4514-a13e-90b15d4cc27a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:00.088026 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-495f8bf3-2bdc-4c81-9789-b2b07a98ea77 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:00.088672 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6eeb4c04-349f-4514-a13e-90b15d4cc27a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:00.096898 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-495f8bf3-2bdc-4c81-9789-b2b07a98ea77 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1577 microversion: 2.1 time: 0.154445 Jun 16 15:03:00.097462 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 492/984] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:59 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:00.216271 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6eeb4c04-349f-4514-a13e-90b15d4cc27a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:00.224016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6eeb4c04-349f-4514-a13e-90b15d4cc27a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:00.225496 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-6eeb4c04-349f-4514-a13e-90b15d4cc27a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:00.226634 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6eeb4c04-349f-4514-a13e-90b15d4cc27a tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.152098 Jun 16 15:03:00.227179 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 493/985] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:00 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:03:00.464527 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-37c0e221-0376-4f22-af2e-224e95c740dc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:00.465400 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-37c0e221-0376-4f22-af2e-224e95c740dc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:00.471801 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-37c0e221-0376-4f22-af2e-224e95c740dc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:00.472253 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-37c0e221-0376-4f22-af2e-224e95c740dc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:00.473018 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-37c0e221-0376-4f22-af2e-224e95c740dc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:00.473457 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-37c0e221-0376-4f22-af2e-224e95c740dc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:00.602316 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-37c0e221-0376-4f22-af2e-224e95c740dc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:00.610207 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-37c0e221-0376-4f22-af2e-224e95c740dc tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1682 microversion: 2.1 time: 0.149610 Jun 16 15:03:00.610919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 493/986] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:00 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:01.073216 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-55461c7b-0317-4f92-bd70-327489f3d509 req-07654f4f-f0eb-47d4-8464-afe118c03056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c044f7d0-a298-4c42-9a40-2bc494b1cdc9", "name": "network-vif-plugged", "status": "completed", "tag": "ee7ef7f3-bf69-418d-ace6-a422233a0197"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:03:01.082945 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-55461c7b-0317-4f92-bd70-327489f3d509 req-07654f4f-f0eb-47d4-8464-afe118c03056 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:01.083543 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-55461c7b-0317-4f92-bd70-327489f3d509 req-07654f4f-f0eb-47d4-8464-afe118c03056 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:01.095622 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-55461c7b-0317-4f92-bd70-327489f3d509 req-07654f4f-f0eb-47d4-8464-afe118c03056 service nova] Creating event network-vif-plugged:ee7ef7f3-bf69-418d-ace6-a422233a0197 for instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 on hv-cinder-83716 Jun 16 15:03:01.101187 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-55461c7b-0317-4f92-bd70-327489f3d509 req-07654f4f-f0eb-47d4-8464-afe118c03056 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031693 Jun 16 15:03:01.101762 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 494/987] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:03:01.114038 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-01175317-7f16-4c6e-ac8d-b35d287b68ed tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:01.114651 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-01175317-7f16-4c6e-ac8d-b35d287b68ed tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:01.121151 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01175317-7f16-4c6e-ac8d-b35d287b68ed tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:01.121605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01175317-7f16-4c6e-ac8d-b35d287b68ed tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:01.122380 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01175317-7f16-4c6e-ac8d-b35d287b68ed tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:01.122823 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01175317-7f16-4c6e-ac8d-b35d287b68ed tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:01.247249 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-396653ad-a951-4840-8534-bed509749d3b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:01.248060 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-396653ad-a951-4840-8534-bed509749d3b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:01.255135 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-396653ad-a951-4840-8534-bed509749d3b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:01.255907 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-396653ad-a951-4840-8534-bed509749d3b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:01.257980 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-396653ad-a951-4840-8534-bed509749d3b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:01.258518 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-396653ad-a951-4840-8534-bed509749d3b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:01.259485 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-01175317-7f16-4c6e-ac8d-b35d287b68ed tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:01.273662 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-01175317-7f16-4c6e-ac8d-b35d287b68ed tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1517 microversion: 2.1 time: 0.163460 Jun 16 15:03:01.274333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 494/988] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:01 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:01.396396 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-396653ad-a951-4840-8534-bed509749d3b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:01.404796 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-396653ad-a951-4840-8534-bed509749d3b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:01.406469 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-396653ad-a951-4840-8534-bed509749d3b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:01.407617 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-396653ad-a951-4840-8534-bed509749d3b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.165621 Jun 16 15:03:01.408452 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 495/989] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:01 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:03:01.627967 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-fd4e6cac-c2d9-4bf4-b613-196adfb52e2b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:01.628607 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-fd4e6cac-c2d9-4bf4-b613-196adfb52e2b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:01.634699 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fd4e6cac-c2d9-4bf4-b613-196adfb52e2b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:01.635153 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fd4e6cac-c2d9-4bf4-b613-196adfb52e2b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:01.635939 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fd4e6cac-c2d9-4bf4-b613-196adfb52e2b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:01.636381 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fd4e6cac-c2d9-4bf4-b613-196adfb52e2b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:01.768707 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fd4e6cac-c2d9-4bf4-b613-196adfb52e2b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:01.776529 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-fd4e6cac-c2d9-4bf4-b613-196adfb52e2b tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1682 microversion: 2.1 time: 0.152467 Jun 16 15:03:01.777098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 495/990] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:01 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:02.291705 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3a586eab-0ca1-4364-978a-2f38cc08a185 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:02.292324 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-3a586eab-0ca1-4364-978a-2f38cc08a185 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:02.298720 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3a586eab-0ca1-4364-978a-2f38cc08a185 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:02.299158 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3a586eab-0ca1-4364-978a-2f38cc08a185 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:02.299931 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3a586eab-0ca1-4364-978a-2f38cc08a185 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:02.300361 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3a586eab-0ca1-4364-978a-2f38cc08a185 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:02.426094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e1d44a75-234f-4bb5-9b95-f1c67af5fa9b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:02.426789 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e1d44a75-234f-4bb5-9b95-f1c67af5fa9b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:02.430131 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3a586eab-0ca1-4364-978a-2f38cc08a185 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:02.434255 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1d44a75-234f-4bb5-9b95-f1c67af5fa9b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:02.434723 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1d44a75-234f-4bb5-9b95-f1c67af5fa9b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:02.435489 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1d44a75-234f-4bb5-9b95-f1c67af5fa9b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:02.435957 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1d44a75-234f-4bb5-9b95-f1c67af5fa9b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:02.438190 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3a586eab-0ca1-4364-978a-2f38cc08a185 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1517 microversion: 2.1 time: 0.150317 Jun 16 15:03:02.438760 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 496/991] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:02 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:02.578334 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e1d44a75-234f-4bb5-9b95-f1c67af5fa9b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:02.586700 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e1d44a75-234f-4bb5-9b95-f1c67af5fa9b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:02.588259 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e1d44a75-234f-4bb5-9b95-f1c67af5fa9b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:02.589431 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e1d44a75-234f-4bb5-9b95-f1c67af5fa9b tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.167353 Jun 16 15:03:02.589980 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 496/992] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:02 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:03:02.798862 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ce14e4b4-a30d-4438-b71b-e2af6fbad360 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:02.799957 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ce14e4b4-a30d-4438-b71b-e2af6fbad360 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:02.807909 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ce14e4b4-a30d-4438-b71b-e2af6fbad360 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:02.808366 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ce14e4b4-a30d-4438-b71b-e2af6fbad360 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:02.809149 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ce14e4b4-a30d-4438-b71b-e2af6fbad360 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:02.809583 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ce14e4b4-a30d-4438-b71b-e2af6fbad360 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:03.017002 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ce14e4b4-a30d-4438-b71b-e2af6fbad360 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:03.027011 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ce14e4b4-a30d-4438-b71b-e2af6fbad360 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1682 microversion: 2.1 time: 0.235218 Jun 16 15:03:03.030103 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 497/993] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:02 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1682 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:03.120205 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-c4780aaa-8be8-4442-ab4b-efe5948a86fb req-c8c6c984-ccb7-4a40-84e7-1d3ede1e9377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c", "name": "network-vif-unplugged", "status": "completed", "tag": "a38f8fd7-717d-49a5-8003-162021ff7c63"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:03:03.131158 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-c4780aaa-8be8-4442-ab4b-efe5948a86fb req-c8c6c984-ccb7-4a40-84e7-1d3ede1e9377 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:03.131612 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-c4780aaa-8be8-4442-ab4b-efe5948a86fb req-c8c6c984-ccb7-4a40-84e7-1d3ede1e9377 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:03.145987 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.compute.server_external_events [req-c4780aaa-8be8-4442-ab4b-efe5948a86fb req-c8c6c984-ccb7-4a40-84e7-1d3ede1e9377 service nova] Unable to find a host for instance 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c. Dropping event network-vif-unplugged {{(pid=117444) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 15:03:03.148049 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-c4780aaa-8be8-4442-ab4b-efe5948a86fb req-c8c6c984-ccb7-4a40-84e7-1d3ede1e9377 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031465 Jun 16 15:03:03.148947 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 497/994] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 15:03:03.456549 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-170873f4-8438-4fcb-852b-53aab25f5c17 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:03.457209 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-170873f4-8438-4fcb-852b-53aab25f5c17 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:03.464434 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-170873f4-8438-4fcb-852b-53aab25f5c17 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:03.464891 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-170873f4-8438-4fcb-852b-53aab25f5c17 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:03.466160 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-170873f4-8438-4fcb-852b-53aab25f5c17 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:03.466597 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-170873f4-8438-4fcb-852b-53aab25f5c17 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:03.607333 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-170873f4-8438-4fcb-852b-53aab25f5c17 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:03.608248 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-44928e17-fc67-4687-ae72-ca1dfcc017c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:03.609002 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-44928e17-fc67-4687-ae72-ca1dfcc017c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:03.616101 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-44928e17-fc67-4687-ae72-ca1dfcc017c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:03.616492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-170873f4-8438-4fcb-852b-53aab25f5c17 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1519 microversion: 2.1 time: 0.163862 Jun 16 15:03:03.617205 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 498/995] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:03 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:03.617893 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-44928e17-fc67-4687-ae72-ca1dfcc017c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:03.619140 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-44928e17-fc67-4687-ae72-ca1dfcc017c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:03.619643 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-44928e17-fc67-4687-ae72-ca1dfcc017c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:03.731345 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-049ee02d-e554-4fdb-9dc0-5eb2e278c202 req-287cddee-7d3d-49fe-a411-f1c6ebf70d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba216f58-575e-4ed9-a34c-1150c21bd527", "name": "network-vif-deleted", "tag": "a89301a0-2f3e-4c5e-b399-8067e370078d"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:03:03.741723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-049ee02d-e554-4fdb-9dc0-5eb2e278c202 req-287cddee-7d3d-49fe-a411-f1c6ebf70d90 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:03.742525 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-049ee02d-e554-4fdb-9dc0-5eb2e278c202 req-287cddee-7d3d-49fe-a411-f1c6ebf70d90 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:03.766191 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-049ee02d-e554-4fdb-9dc0-5eb2e278c202 req-287cddee-7d3d-49fe-a411-f1c6ebf70d90 service nova] Creating event network-vif-deleted:a89301a0-2f3e-4c5e-b399-8067e370078d for instance ba216f58-575e-4ed9-a34c-1150c21bd527 on hv-cinder-83716 Jun 16 15:03:03.780084 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-049ee02d-e554-4fdb-9dc0-5eb2e278c202 req-287cddee-7d3d-49fe-a411-f1c6ebf70d90 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052218 Jun 16 15:03:03.784809 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 499/996] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:03:03.812406 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-44928e17-fc67-4687-ae72-ca1dfcc017c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:03.821098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-44928e17-fc67-4687-ae72-ca1dfcc017c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:03.822731 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-44928e17-fc67-4687-ae72-ca1dfcc017c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:03.832699 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-44928e17-fc67-4687-ae72-ca1dfcc017c4 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.228836 Jun 16 15:03:03.833299 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 498/997] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:03 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:03:04.047393 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d9597627-e665-4357-b482-34fd75000ad5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:04.048091 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d9597627-e665-4357-b482-34fd75000ad5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:04.054401 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d9597627-e665-4357-b482-34fd75000ad5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:04.055082 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d9597627-e665-4357-b482-34fd75000ad5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:04.055870 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d9597627-e665-4357-b482-34fd75000ad5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:04.056300 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d9597627-e665-4357-b482-34fd75000ad5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:04.090042 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d9597627-e665-4357-b482-34fd75000ad5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:04.090498 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d9597627-e665-4357-b482-34fd75000ad5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:04.090943 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.objects.instance [None req-d9597627-e665-4357-b482-34fd75000ad5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lazy-loading 'fault' on Instance uuid ba216f58-575e-4ed9-a34c-1150c21bd527 {{(pid=117443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:03:04.167610 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d9597627-e665-4357-b482-34fd75000ad5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a6ec62b5414930bf36f69f072d7df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ade68614ac4730a35c9958123d06e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:04.176425 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d9597627-e665-4357-b482-34fd75000ad5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 200 len: 1332 microversion: 2.1 time: 0.133196 Jun 16 15:03:04.177054 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 500/998] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:04 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 1332 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:04.638382 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-59e64f73-fc5a-4544-aec2-81c335d5a5cf tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:04.639512 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-59e64f73-fc5a-4544-aec2-81c335d5a5cf tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:04.648689 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-59e64f73-fc5a-4544-aec2-81c335d5a5cf tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:04.649234 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-59e64f73-fc5a-4544-aec2-81c335d5a5cf tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:04.650085 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-59e64f73-fc5a-4544-aec2-81c335d5a5cf tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:04.650592 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-59e64f73-fc5a-4544-aec2-81c335d5a5cf tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:04.825275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-59e64f73-fc5a-4544-aec2-81c335d5a5cf tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:04.835836 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-59e64f73-fc5a-4544-aec2-81c335d5a5cf tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1575 microversion: 2.1 time: 0.203546 Jun 16 15:03:04.836684 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 499/999] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:04 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:04.853069 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-16e22a7b-c096-4982-9d17-e737c9c7bc80 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:04.854388 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-16e22a7b-c096-4982-9d17-e737c9c7bc80 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:04.864102 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-16e22a7b-c096-4982-9d17-e737c9c7bc80 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:04.864613 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-16e22a7b-c096-4982-9d17-e737c9c7bc80 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:04.865400 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-16e22a7b-c096-4982-9d17-e737c9c7bc80 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:04.865843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-16e22a7b-c096-4982-9d17-e737c9c7bc80 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:05.011160 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-16e22a7b-c096-4982-9d17-e737c9c7bc80 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:05.019886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-16e22a7b-c096-4982-9d17-e737c9c7bc80 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:05.021381 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-16e22a7b-c096-4982-9d17-e737c9c7bc80 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:05.022525 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-16e22a7b-c096-4982-9d17-e737c9c7bc80 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1728 microversion: 2.20 time: 0.173954 Jun 16 15:03:05.023085 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 501/1000] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:04 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:03:05.194464 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-840c0413-0d2a-403e-98e2-4d95c976a404 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:05.195066 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-840c0413-0d2a-403e-98e2-4d95c976a404 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:05.202391 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-840c0413-0d2a-403e-98e2-4d95c976a404 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:05.202836 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-840c0413-0d2a-403e-98e2-4d95c976a404 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:05.203603 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-840c0413-0d2a-403e-98e2-4d95c976a404 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:05.204197 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-840c0413-0d2a-403e-98e2-4d95c976a404 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:05.219726 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-840c0413-0d2a-403e-98e2-4d95c976a404 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] HTTP exception thrown: Instance ba216f58-575e-4ed9-a34c-1150c21bd527 could not be found. Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-840c0413-0d2a-403e-98e2-4d95c976a404 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Request method failure captured: Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 HTTP/1.1 Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0RvgNnHERAvlrn1WvFUUcvodkCzzgEgc9uA3Ra8J3x-gaqNyXJgZlXW9Fu3DW2tOgMnX7C8vwaaaUd2R9Mf98qk7wOTE2lojDUYY_ofhKl3QsPjUp0j-B30CwpTfHwGiZa1GU9kj2dLQMYLnA0B8U66Nc60nNiPBn1l71iNpcPmPQ4 Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:03:05.221352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:03:05.222996 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_60ade68614ac4730a35c9958123d06e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:03:05.222996 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:05.222996 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:03:05.222996 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:05.222996 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:03:05.222996 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:03:05.222996 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:03:05.222996 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 87a6ec62b5414930bf36f69f072d7df6 Jun 16 15:03:05.222996 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:03:05.222996 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:03:05.222996 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance ba216f58-575e-4ed9-a34c-1150c21bd527 could not be found. Jun 16 15:03:05.222996 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': 'ba216f58-575e-4ed9-a34c-1150c21bd527'} Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba216f58-575e-4ed9-a34c-1150c21bd527 could not be found. Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:03:05.223916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:03:05.225821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:03:05.225821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:03:05.225821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:03:05.225821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:03:05.225821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:03:05.225821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:03:05.225821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:03:05.225821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba216f58-575e-4ed9-a34c-1150c21bd527 could not be found. Jun 16 15:03:05.225821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:05.225821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:05.225821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:05.225821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:05.225821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:05.225821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:05.225821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:03:05.225821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:03:05.225821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba216f58-575e-4ed9-a34c-1150c21bd527 could not be found. Jun 16 15:03:05.225821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:05.226987 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-840c0413-0d2a-403e-98e2-4d95c976a404 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Returning 404 to user: Instance ba216f58-575e-4ed9-a34c-1150c21bd527 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:03:05.226987 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-840c0413-0d2a-403e-98e2-4d95c976a404 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 404 len: 111 microversion: 2.1 time: 0.032233 Jun 16 15:03:05.226987 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 500/1001] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:05 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 15:03:05.232669 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a7a41fff-d17f-4b09-abca-c1911a9115f5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '.version_select at 0x7f33e12de670>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:05.250641 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a7a41fff-d17f-4b09-abca-c1911a9115f5 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064478703" status: 202 len: 0 microversion: 2.1 time: 0.022486 Jun 16 15:03:05.251206 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 502/1002] 10.222.0.76 () {58 vars in 1220 bytes} [Thu Jun 16 15:03:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064478703 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:03:05.854016 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9e071565-0937-470c-bf5f-3345dd150de7 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:05.855024 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9e071565-0937-470c-bf5f-3345dd150de7 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:05.862217 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9e071565-0937-470c-bf5f-3345dd150de7 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:05.862674 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9e071565-0937-470c-bf5f-3345dd150de7 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:05.863517 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9e071565-0937-470c-bf5f-3345dd150de7 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:05.864019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9e071565-0937-470c-bf5f-3345dd150de7 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:06.002528 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9e071565-0937-470c-bf5f-3345dd150de7 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:06.010117 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9e071565-0937-470c-bf5f-3345dd150de7 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1575 microversion: 2.1 time: 0.160556 Jun 16 15:03:06.010673 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 501/1003] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:05 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:06.040989 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-977ef713-a39b-4187-99f4-94d1f4603d76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:06.041519 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-977ef713-a39b-4187-99f4-94d1f4603d76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:06.048157 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-977ef713-a39b-4187-99f4-94d1f4603d76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:06.048601 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-977ef713-a39b-4187-99f4-94d1f4603d76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:06.049352 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-977ef713-a39b-4187-99f4-94d1f4603d76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:06.049785 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-977ef713-a39b-4187-99f4-94d1f4603d76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:06.054408 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:06.180879 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-977ef713-a39b-4187-99f4-94d1f4603d76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:06.189425 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-977ef713-a39b-4187-99f4-94d1f4603d76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:06.190922 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-977ef713-a39b-4187-99f4-94d1f4603d76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:06.192105 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-977ef713-a39b-4187-99f4-94d1f4603d76 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1715 microversion: 2.20 time: 0.155645 Jun 16 15:03:06.192657 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 503/1004] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:06 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:03:07.027404 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7a969355-6d15-4553-b699-63f7289ed174 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:07.028080 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7a969355-6d15-4553-b699-63f7289ed174 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:07.035389 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7a969355-6d15-4553-b699-63f7289ed174 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:07.035869 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7a969355-6d15-4553-b699-63f7289ed174 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:07.036627 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7a969355-6d15-4553-b699-63f7289ed174 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:07.037059 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7a969355-6d15-4553-b699-63f7289ed174 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:07.166749 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7a969355-6d15-4553-b699-63f7289ed174 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:07.175064 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7a969355-6d15-4553-b699-63f7289ed174 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1575 microversion: 2.1 time: 0.151525 Jun 16 15:03:07.175616 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 502/1005] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:07 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:08.192543 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-2f45ed2d-128d-4f0f-8ded-3e43f189777e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:08.193273 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-2f45ed2d-128d-4f0f-8ded-3e43f189777e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:08.200396 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2f45ed2d-128d-4f0f-8ded-3e43f189777e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:08.200844 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2f45ed2d-128d-4f0f-8ded-3e43f189777e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:08.201598 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2f45ed2d-128d-4f0f-8ded-3e43f189777e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:08.202027 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2f45ed2d-128d-4f0f-8ded-3e43f189777e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:08.333122 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2f45ed2d-128d-4f0f-8ded-3e43f189777e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:08.341732 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-2f45ed2d-128d-4f0f-8ded-3e43f189777e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1575 microversion: 2.1 time: 0.153115 Jun 16 15:03:08.342443 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 504/1006] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:08 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:09.102935 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-14922a73-df5f-44b5-b766-cc1f72d2acd0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:09.103425 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-14922a73-df5f-44b5-b766-cc1f72d2acd0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:09.110486 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-14922a73-df5f-44b5-b766-cc1f72d2acd0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:09.110941 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-14922a73-df5f-44b5-b766-cc1f72d2acd0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:09.111741 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-14922a73-df5f-44b5-b766-cc1f72d2acd0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:09.112187 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-14922a73-df5f-44b5-b766-cc1f72d2acd0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:09.125785 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-14922a73-df5f-44b5-b766-cc1f72d2acd0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] HTTP exception thrown: Instance ba216f58-575e-4ed9-a34c-1150c21bd527 could not be found. Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-14922a73-df5f-44b5-b766-cc1f72d2acd0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Request method failure captured: Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: DELETE /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 HTTP/1.1 Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0RvgNnHERAvlrn1WvFUUcvodkCzzgEgc9uA3Ra8J3x-gaqNyXJgZlXW9Fu3DW2tOgMnX7C8vwaaaUd2R9Mf98qk7wOTE2lojDUYY_ofhKl3QsPjUp0j-B30CwpTfHwGiZa1GU9kj2dLQMYLnA0B8U66Nc60nNiPBn1l71iNpcPmPQ4 Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:03:09.127346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:03:09.128989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_60ade68614ac4730a35c9958123d06e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:03:09.128989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:09.128989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:03:09.128989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:09.128989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:03:09.128989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:03:09.128989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:03:09.128989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 87a6ec62b5414930bf36f69f072d7df6 Jun 16 15:03:09.128989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:03:09.128989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:03:09.128989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance ba216f58-575e-4ed9-a34c-1150c21bd527 could not be found. Jun 16 15:03:09.128989 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': 'ba216f58-575e-4ed9-a34c-1150c21bd527'} Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba216f58-575e-4ed9-a34c-1150c21bd527 could not be found. Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:03:09.129885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba216f58-575e-4ed9-a34c-1150c21bd527 could not be found. Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba216f58-575e-4ed9-a34c-1150c21bd527 could not be found. Jun 16 15:03:09.131311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:09.132780 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-14922a73-df5f-44b5-b766-cc1f72d2acd0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Returning 404 to user: Instance ba216f58-575e-4ed9-a34c-1150c21bd527 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:03:09.132780 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-14922a73-df5f-44b5-b766-cc1f72d2acd0 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 404 len: 111 microversion: 2.1 time: 0.029762 Jun 16 15:03:09.132780 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 503/1007] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:03:09 2022] DELETE /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:03:09.137142 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-87eb15b5-a18f-4680-9852-9ad8e868b0e7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:09.140541 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-87eb15b5-a18f-4680-9852-9ad8e868b0e7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: ba216f58-575e-4ed9-a34c-1150c21bd527] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:09.146600 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-87eb15b5-a18f-4680-9852-9ad8e868b0e7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:09.147040 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-87eb15b5-a18f-4680-9852-9ad8e868b0e7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:09.147912 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-87eb15b5-a18f-4680-9852-9ad8e868b0e7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:09.148339 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-87eb15b5-a18f-4680-9852-9ad8e868b0e7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:09.163413 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-87eb15b5-a18f-4680-9852-9ad8e868b0e7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] HTTP exception thrown: Instance ba216f58-575e-4ed9-a34c-1150c21bd527 could not be found. Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-87eb15b5-a18f-4680-9852-9ad8e868b0e7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Request method failure captured: Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 HTTP/1.1 Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0RvgNnHERAvlrn1WvFUUcvodkCzzgEgc9uA3Ra8J3x-gaqNyXJgZlXW9Fu3DW2tOgMnX7C8vwaaaUd2R9Mf98qk7wOTE2lojDUYY_ofhKl3QsPjUp0j-B30CwpTfHwGiZa1GU9kj2dLQMYLnA0B8U66Nc60nNiPBn1l71iNpcPmPQ4 Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 15:03:09.165095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 15:03:09.166749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_60ade68614ac4730a35c9958123d06e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:03:09.166749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:09.166749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:03:09.166749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:09.166749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:03:09.166749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 15:03:09.166749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 15:03:09.166749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: 87a6ec62b5414930bf36f69f072d7df6 Jun 16 15:03:09.166749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:03:09.166749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 15:03:09.166749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance ba216f58-575e-4ed9-a34c-1150c21bd527 could not be found. Jun 16 15:03:09.166749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': 'ba216f58-575e-4ed9-a34c-1150c21bd527'} Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba216f58-575e-4ed9-a34c-1150c21bd527 could not be found. Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:03:09.167559 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:03:09.168805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:03:09.168805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:03:09.168805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:03:09.168805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:03:09.168805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:03:09.168805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:03:09.168805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:03:09.168805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba216f58-575e-4ed9-a34c-1150c21bd527 could not be found. Jun 16 15:03:09.168805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:09.168805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:09.168805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:09.168805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:09.168805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:09.168805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:09.168805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:03:09.168805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:03:09.168805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba216f58-575e-4ed9-a34c-1150c21bd527 could not be found. Jun 16 15:03:09.168805 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:09.169871 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-87eb15b5-a18f-4680-9852-9ad8e868b0e7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Returning 404 to user: Instance ba216f58-575e-4ed9-a34c-1150c21bd527 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:03:09.169871 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-87eb15b5-a18f-4680-9852-9ad8e868b0e7 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527" status: 404 len: 111 microversion: 2.1 time: 0.033146 Jun 16 15:03:09.169871 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 505/1008] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:09 2022] GET /compute/v2.1/servers/ba216f58-575e-4ed9-a34c-1150c21bd527 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:03:09.359199 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f56e4fff-3962-4fd9-a64d-aaa1ace7880e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:09.359833 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f56e4fff-3962-4fd9-a64d-aaa1ace7880e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:09.365787 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f56e4fff-3962-4fd9-a64d-aaa1ace7880e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:09.366233 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f56e4fff-3962-4fd9-a64d-aaa1ace7880e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:09.366992 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f56e4fff-3962-4fd9-a64d-aaa1ace7880e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:09.367426 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f56e4fff-3962-4fd9-a64d-aaa1ace7880e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:09.502616 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f56e4fff-3962-4fd9-a64d-aaa1ace7880e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:09.513560 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f56e4fff-3962-4fd9-a64d-aaa1ace7880e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1575 microversion: 2.1 time: 0.158160 Jun 16 15:03:09.514273 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 504/1009] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:09 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:10.303864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ad670fd8-0b5f-4619-a31f-b62afa730818 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:10.304496 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ad670fd8-0b5f-4619-a31f-b62afa730818 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:10.311265 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ad670fd8-0b5f-4619-a31f-b62afa730818 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:10.311646 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ad670fd8-0b5f-4619-a31f-b62afa730818 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:10.312528 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ad670fd8-0b5f-4619-a31f-b62afa730818 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:10.312957 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ad670fd8-0b5f-4619-a31f-b62afa730818 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:10.326689 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-ad670fd8-0b5f-4619-a31f-b62afa730818 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] HTTP exception thrown: Instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 could not be found. Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ad670fd8-0b5f-4619-a31f-b62afa730818 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Request method failure captured: Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: DELETE /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 HTTP/1.1 Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0RvgNnHERAvlrn1WvFUUcvodkCzzgEgc9uA3Ra8J3x-gaqNyXJgZlXW9Fu3DW2tOgMnX7C8vwaaaUd2R9Mf98qk7wOTE2lojDUYY_ofhKl3QsPjUp0j-B30CwpTfHwGiZa1GU9kj2dLQMYLnA0B8U66Nc60nNiPBn1l71iNpcPmPQ4 Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 15:03:10.328346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 15:03:10.329956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_60ade68614ac4730a35c9958123d06e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:03:10.329956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:10.329956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:03:10.329956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:10.329956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:03:10.329956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 15:03:10.329956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 15:03:10.329956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: 87a6ec62b5414930bf36f69f072d7df6 Jun 16 15:03:10.329956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:03:10.329956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 15:03:10.329956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 could not be found. Jun 16 15:03:10.329956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': 'f4d7f1ee-c351-40d2-8751-bbb43c7e4a57'} Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 could not be found. Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:03:10.330750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 could not be found. Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 could not be found. Jun 16 15:03:10.332481 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.333873 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ad670fd8-0b5f-4619-a31f-b62afa730818 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Returning 404 to user: Instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:03:10.333873 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ad670fd8-0b5f-4619-a31f-b62afa730818 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 404 len: 111 microversion: 2.1 time: 0.029757 Jun 16 15:03:10.333873 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 506/1010] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:03:10 2022] DELETE /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:03:10.338926 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-dc8ca873-1c56-4215-95b0-c460ea008ef4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:10.339653 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-dc8ca873-1c56-4215-95b0-c460ea008ef4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: f4d7f1ee-c351-40d2-8751-bbb43c7e4a57] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:10.346727 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dc8ca873-1c56-4215-95b0-c460ea008ef4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:10.347175 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dc8ca873-1c56-4215-95b0-c460ea008ef4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:10.347962 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dc8ca873-1c56-4215-95b0-c460ea008ef4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:10.348405 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dc8ca873-1c56-4215-95b0-c460ea008ef4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:10.362932 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-dc8ca873-1c56-4215-95b0-c460ea008ef4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] HTTP exception thrown: Instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 could not be found. Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-dc8ca873-1c56-4215-95b0-c460ea008ef4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Request method failure captured: Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 HTTP/1.1 Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0RvgNnHERAvlrn1WvFUUcvodkCzzgEgc9uA3Ra8J3x-gaqNyXJgZlXW9Fu3DW2tOgMnX7C8vwaaaUd2R9Mf98qk7wOTE2lojDUYY_ofhKl3QsPjUp0j-B30CwpTfHwGiZa1GU9kj2dLQMYLnA0B8U66Nc60nNiPBn1l71iNpcPmPQ4 Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:03:10.364514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:03:10.366329 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_60ade68614ac4730a35c9958123d06e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:03:10.366329 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:10.366329 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:03:10.366329 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:10.366329 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:03:10.366329 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:03:10.366329 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:03:10.366329 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 87a6ec62b5414930bf36f69f072d7df6 Jun 16 15:03:10.366329 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:03:10.366329 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:03:10.366329 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 could not be found. Jun 16 15:03:10.366329 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': 'f4d7f1ee-c351-40d2-8751-bbb43c7e4a57'} Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 could not be found. Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:03:10.367219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:03:10.368729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:03:10.368729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:03:10.368729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:03:10.368729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:03:10.368729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:03:10.368729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:03:10.368729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:03:10.368729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 could not be found. Jun 16 15:03:10.368729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.368729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:10.368729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.368729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:10.368729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:10.368729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:10.368729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:03:10.368729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:03:10.368729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 could not be found. Jun 16 15:03:10.368729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.370254 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-dc8ca873-1c56-4215-95b0-c460ea008ef4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Returning 404 to user: Instance f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:03:10.370254 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-dc8ca873-1c56-4215-95b0-c460ea008ef4 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57" status: 404 len: 111 microversion: 2.1 time: 0.031235 Jun 16 15:03:10.370254 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 505/1011] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:10 2022] GET /compute/v2.1/servers/f4d7f1ee-c351-40d2-8751-bbb43c7e4a57 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:03:10.376307 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e6554bf8-bb5c-4c28-af04-97e2401c869a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:10.376842 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e6554bf8-bb5c-4c28-af04-97e2401c869a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:10.384243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e6554bf8-bb5c-4c28-af04-97e2401c869a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:10.384695 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e6554bf8-bb5c-4c28-af04-97e2401c869a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:10.385514 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e6554bf8-bb5c-4c28-af04-97e2401c869a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:10.385945 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e6554bf8-bb5c-4c28-af04-97e2401c869a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:10.402790 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-e6554bf8-bb5c-4c28-af04-97e2401c869a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] HTTP exception thrown: Instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 could not be found. Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e6554bf8-bb5c-4c28-af04-97e2401c869a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Request method failure captured: Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: DELETE /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 HTTP/1.1 Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0RvgNnHERAvlrn1WvFUUcvodkCzzgEgc9uA3Ra8J3x-gaqNyXJgZlXW9Fu3DW2tOgMnX7C8vwaaaUd2R9Mf98qk7wOTE2lojDUYY_ofhKl3QsPjUp0j-B30CwpTfHwGiZa1GU9kj2dLQMYLnA0B8U66Nc60nNiPBn1l71iNpcPmPQ4 Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 15:03:10.404376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 15:03:10.405831 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_60ade68614ac4730a35c9958123d06e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:03:10.405831 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:10.405831 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:03:10.405831 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:10.405831 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:03:10.405831 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 15:03:10.405831 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 15:03:10.405831 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: 87a6ec62b5414930bf36f69f072d7df6 Jun 16 15:03:10.405831 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:03:10.405831 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 15:03:10.405831 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 could not be found. Jun 16 15:03:10.405831 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': '36bbbe9f-1cae-453f-9d25-38654f3e30a8'} Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 could not be found. Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:03:10.406572 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 could not be found. Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 could not be found. Jun 16 15:03:10.407834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.409321 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e6554bf8-bb5c-4c28-af04-97e2401c869a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Returning 404 to user: Instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:03:10.409321 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e6554bf8-bb5c-4c28-af04-97e2401c869a tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "DELETE /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 404 len: 111 microversion: 2.1 time: 0.035060 Jun 16 15:03:10.409321 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 507/1012] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:03:10 2022] DELETE /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:03:10.414796 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-090799d2-4828-4ec2-8d61-cbe6632faa69 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:10.415426 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-090799d2-4828-4ec2-8d61-cbe6632faa69 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: 36bbbe9f-1cae-453f-9d25-38654f3e30a8] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:10.423409 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-090799d2-4828-4ec2-8d61-cbe6632faa69 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:10.423907 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-090799d2-4828-4ec2-8d61-cbe6632faa69 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:10.424683 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-090799d2-4828-4ec2-8d61-cbe6632faa69 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:10.425120 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-090799d2-4828-4ec2-8d61-cbe6632faa69 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:10.440387 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-090799d2-4828-4ec2-8d61-cbe6632faa69 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] HTTP exception thrown: Instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 could not be found. Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-090799d2-4828-4ec2-8d61-cbe6632faa69 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Request method failure captured: Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 HTTP/1.1 Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0RvgNnHERAvlrn1WvFUUcvodkCzzgEgc9uA3Ra8J3x-gaqNyXJgZlXW9Fu3DW2tOgMnX7C8vwaaaUd2R9Mf98qk7wOTE2lojDUYY_ofhKl3QsPjUp0j-B30CwpTfHwGiZa1GU9kj2dLQMYLnA0B8U66Nc60nNiPBn1l71iNpcPmPQ4 Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:03:10.441919 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:03:10.443554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_60ade68614ac4730a35c9958123d06e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:03:10.443554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:10.443554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:03:10.443554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:10.443554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:03:10.443554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:03:10.443554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:03:10.443554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 87a6ec62b5414930bf36f69f072d7df6 Jun 16 15:03:10.443554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:03:10.443554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:03:10.443554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 could not be found. Jun 16 15:03:10.443554 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': '36bbbe9f-1cae-453f-9d25-38654f3e30a8'} Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 could not be found. Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:03:10.444520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:03:10.446062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:03:10.446062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:03:10.446062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:03:10.446062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:03:10.446062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:03:10.446062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:03:10.446062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:03:10.446062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 could not be found. Jun 16 15:03:10.446062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.446062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:10.446062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.446062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:10.446062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:10.446062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:10.446062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:03:10.446062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:03:10.446062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 could not be found. Jun 16 15:03:10.446062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:10.447631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-090799d2-4828-4ec2-8d61-cbe6632faa69 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Returning 404 to user: Instance 36bbbe9f-1cae-453f-9d25-38654f3e30a8 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:03:10.447631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-090799d2-4828-4ec2-8d61-cbe6632faa69 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8" status: 404 len: 111 microversion: 2.1 time: 0.032297 Jun 16 15:03:10.447631 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 506/1013] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:10 2022] GET /compute/v2.1/servers/36bbbe9f-1cae-453f-9d25-38654f3e30a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:03:10.531950 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-26b76d7e-c91b-4689-b65a-0638151587f0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:10.532891 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-26b76d7e-c91b-4689-b65a-0638151587f0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:10.539494 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-26b76d7e-c91b-4689-b65a-0638151587f0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:10.539984 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-26b76d7e-c91b-4689-b65a-0638151587f0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:10.540768 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-26b76d7e-c91b-4689-b65a-0638151587f0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:10.541204 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-26b76d7e-c91b-4689-b65a-0638151587f0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:10.679513 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-26b76d7e-c91b-4689-b65a-0638151587f0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:10.687876 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-26b76d7e-c91b-4689-b65a-0638151587f0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1575 microversion: 2.1 time: 0.160096 Jun 16 15:03:10.688438 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 508/1014] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:10 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:11.584625 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-77b4877c-970c-4191-88e2-2ac88400b483 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:11.585138 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-77b4877c-970c-4191-88e2-2ac88400b483 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:11.591787 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-77b4877c-970c-4191-88e2-2ac88400b483 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:11.592244 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-77b4877c-970c-4191-88e2-2ac88400b483 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:11.593146 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-77b4877c-970c-4191-88e2-2ac88400b483 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:11.593589 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-77b4877c-970c-4191-88e2-2ac88400b483 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:11.607234 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-77b4877c-970c-4191-88e2-2ac88400b483 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] HTTP exception thrown: Instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 could not be found. Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-77b4877c-970c-4191-88e2-2ac88400b483 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Request method failure captured: Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: DELETE /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 HTTP/1.1 Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0RvgNnHERAvlrn1WvFUUcvodkCzzgEgc9uA3Ra8J3x-gaqNyXJgZlXW9Fu3DW2tOgMnX7C8vwaaaUd2R9Mf98qk7wOTE2lojDUYY_ofhKl3QsPjUp0j-B30CwpTfHwGiZa1GU9kj2dLQMYLnA0B8U66Nc60nNiPBn1l71iNpcPmPQ4 Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:03:11.608855 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:03:11.610439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_60ade68614ac4730a35c9958123d06e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:03:11.610439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:11.610439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:03:11.610439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:11.610439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:03:11.610439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:03:11.610439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:03:11.610439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 87a6ec62b5414930bf36f69f072d7df6 Jun 16 15:03:11.610439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:03:11.610439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:03:11.610439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 could not be found. Jun 16 15:03:11.610439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': 'fdb2c36e-f3e4-44bf-bec8-b512d6b0c970'} Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 could not be found. Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:03:11.611323 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 could not be found. Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 could not be found. Jun 16 15:03:11.612807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:11.614343 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-77b4877c-970c-4191-88e2-2ac88400b483 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Returning 404 to user: Instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:03:11.614343 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-77b4877c-970c-4191-88e2-2ac88400b483 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "DELETE /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 404 len: 111 microversion: 2.1 time: 0.029519 Jun 16 15:03:11.614343 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 507/1015] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:03:11 2022] DELETE /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:03:11.618944 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d8fa7c04-7977-454c-9b48-9a3efeddbf97 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:11.619609 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d8fa7c04-7977-454c-9b48-9a3efeddbf97 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] [instance: fdb2c36e-f3e4-44bf-bec8-b512d6b0c970] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:11.627245 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d8fa7c04-7977-454c-9b48-9a3efeddbf97 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:11.627727 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d8fa7c04-7977-454c-9b48-9a3efeddbf97 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:11.628546 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d8fa7c04-7977-454c-9b48-9a3efeddbf97 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:11.628981 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d8fa7c04-7977-454c-9b48-9a3efeddbf97 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:11.643801 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-d8fa7c04-7977-454c-9b48-9a3efeddbf97 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] HTTP exception thrown: Instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 could not be found. Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d8fa7c04-7977-454c-9b48-9a3efeddbf97 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Request method failure captured: Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 HTTP/1.1 Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0RvgNnHERAvlrn1WvFUUcvodkCzzgEgc9uA3Ra8J3x-gaqNyXJgZlXW9Fu3DW2tOgMnX7C8vwaaaUd2R9Mf98qk7wOTE2lojDUYY_ofhKl3QsPjUp0j-B30CwpTfHwGiZa1GU9kj2dLQMYLnA0B8U66Nc60nNiPBn1l71iNpcPmPQ4 Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 15:03:11.645325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 15:03:11.646924 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_60ade68614ac4730a35c9958123d06e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60ade68614ac4730a35c9958123d06e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:03:11.646924 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:11.646924 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 60ade68614ac4730a35c9958123d06e8 Jun 16 15:03:11.646924 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1152162191 Jun 16 15:03:11.646924 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:03:11.646924 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 15:03:11.646924 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 15:03:11.646924 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: 87a6ec62b5414930bf36f69f072d7df6 Jun 16 15:03:11.646924 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-AttachVolumeNegativeTest-1152162191-project Jun 16 15:03:11.646924 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 15:03:11.646924 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 could not be found. Jun 16 15:03:11.646924 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': 'fdb2c36e-f3e4-44bf-bec8-b512d6b0c970'} Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 could not be found. Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:03:11.647864 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:03:11.649344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:03:11.649344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:03:11.649344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:03:11.649344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:03:11.649344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:03:11.649344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:03:11.649344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:03:11.649344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 could not be found. Jun 16 15:03:11.649344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:11.649344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:11.649344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:11.649344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:11.649344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:11.649344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:11.649344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:03:11.649344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:03:11.649344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 could not be found. Jun 16 15:03:11.649344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:11.650570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d8fa7c04-7977-454c-9b48-9a3efeddbf97 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] Returning 404 to user: Instance fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:03:11.650570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d8fa7c04-7977-454c-9b48-9a3efeddbf97 tempest-AttachVolumeNegativeTest-1152162191 tempest-AttachVolumeNegativeTest-1152162191-project] 10.222.0.76 "GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970" status: 404 len: 111 microversion: 2.1 time: 0.031790 Jun 16 15:03:11.650570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 509/1016] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:11 2022] GET /compute/v2.1/servers/fdb2c36e-f3e4-44bf-bec8-b512d6b0c970 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 15:03:11.705529 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0b4e41a9-f07e-41ee-b9c3-a766f660abf3 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:11.706175 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0b4e41a9-f07e-41ee-b9c3-a766f660abf3 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:11.712044 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0b4e41a9-f07e-41ee-b9c3-a766f660abf3 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:11.712492 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0b4e41a9-f07e-41ee-b9c3-a766f660abf3 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:11.713269 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0b4e41a9-f07e-41ee-b9c3-a766f660abf3 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:11.713714 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0b4e41a9-f07e-41ee-b9c3-a766f660abf3 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:11.873815 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0b4e41a9-f07e-41ee-b9c3-a766f660abf3 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:11.881499 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0b4e41a9-f07e-41ee-b9c3-a766f660abf3 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1575 microversion: 2.1 time: 0.179773 Jun 16 15:03:11.882058 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 508/1017] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:11 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:12.899595 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f1b86cd1-3359-4aa7-a8c2-d4e34d00fdb6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:12.900321 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f1b86cd1-3359-4aa7-a8c2-d4e34d00fdb6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:12.906960 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f1b86cd1-3359-4aa7-a8c2-d4e34d00fdb6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:12.907477 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f1b86cd1-3359-4aa7-a8c2-d4e34d00fdb6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:12.908623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f1b86cd1-3359-4aa7-a8c2-d4e34d00fdb6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:12.909119 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f1b86cd1-3359-4aa7-a8c2-d4e34d00fdb6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:13.039670 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f1b86cd1-3359-4aa7-a8c2-d4e34d00fdb6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:13.048248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f1b86cd1-3359-4aa7-a8c2-d4e34d00fdb6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1575 microversion: 2.1 time: 0.152514 Jun 16 15:03:13.048811 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 510/1018] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:12 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:14.066248 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5739d893-cf20-425e-b0ee-b19b653d40df tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:14.071885 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5739d893-cf20-425e-b0ee-b19b653d40df tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:14.082656 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5739d893-cf20-425e-b0ee-b19b653d40df tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:14.083107 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5739d893-cf20-425e-b0ee-b19b653d40df tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:14.083939 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5739d893-cf20-425e-b0ee-b19b653d40df tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:14.084534 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5739d893-cf20-425e-b0ee-b19b653d40df tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:14.113035 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:14.285243 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5739d893-cf20-425e-b0ee-b19b653d40df tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:14.294004 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5739d893-cf20-425e-b0ee-b19b653d40df tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1575 microversion: 2.1 time: 0.231079 Jun 16 15:03:14.295252 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 509/1019] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:14 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1575 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:15.316944 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-9e2fc730-af08-485f-97e4-0fedcdf48b7e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:15.317630 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-9e2fc730-af08-485f-97e4-0fedcdf48b7e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:15.328042 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9e2fc730-af08-485f-97e4-0fedcdf48b7e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:15.329650 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9e2fc730-af08-485f-97e4-0fedcdf48b7e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:15.330653 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9e2fc730-af08-485f-97e4-0fedcdf48b7e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:15.331248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9e2fc730-af08-485f-97e4-0fedcdf48b7e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:15.546087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-9e2fc730-af08-485f-97e4-0fedcdf48b7e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:15.557802 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-9e2fc730-af08-485f-97e4-0fedcdf48b7e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1575 microversion: 2.1 time: 0.249495 Jun 16 15:03:15.558516 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 511/1020] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:15 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1575 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:16.575466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c3e59035-c1de-45d7-b5a0-3a2daf05405b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:16.576142 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c3e59035-c1de-45d7-b5a0-3a2daf05405b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:16.582629 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c3e59035-c1de-45d7-b5a0-3a2daf05405b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:16.583081 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c3e59035-c1de-45d7-b5a0-3a2daf05405b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:16.583936 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c3e59035-c1de-45d7-b5a0-3a2daf05405b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:16.584438 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c3e59035-c1de-45d7-b5a0-3a2daf05405b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:16.979182 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c3e59035-c1de-45d7-b5a0-3a2daf05405b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:16.988117 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c3e59035-c1de-45d7-b5a0-3a2daf05405b tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1575 microversion: 2.1 time: 0.416398 Jun 16 15:03:16.989036 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 510/1021] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:16 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1575 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:17.225837 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-8349b42d-fd3d-442e-b968-0f1a2848f9d5 req-fbdfe5dd-10a1-4f7a-995d-88c4c0125707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c", "name": "network-vif-plugged", "status": "completed", "tag": "a38f8fd7-717d-49a5-8003-162021ff7c63"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:03:17.238920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-8349b42d-fd3d-442e-b968-0f1a2848f9d5 req-fbdfe5dd-10a1-4f7a-995d-88c4c0125707 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:17.239407 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-8349b42d-fd3d-442e-b968-0f1a2848f9d5 req-fbdfe5dd-10a1-4f7a-995d-88c4c0125707 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:17.259974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-8349b42d-fd3d-442e-b968-0f1a2848f9d5 req-fbdfe5dd-10a1-4f7a-995d-88c4c0125707 service nova] Creating event network-vif-plugged:a38f8fd7-717d-49a5-8003-162021ff7c63 for instance 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c on hv-cinder-83716 Jun 16 15:03:17.266088 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-8349b42d-fd3d-442e-b968-0f1a2848f9d5 req-fbdfe5dd-10a1-4f7a-995d-88c4c0125707 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044513 Jun 16 15:03:17.267225 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 512/1022] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:03:18.005432 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-418e7e1d-63ea-4272-8212-57a8a614b090 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:18.006068 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-418e7e1d-63ea-4272-8212-57a8a614b090 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:18.013608 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-418e7e1d-63ea-4272-8212-57a8a614b090 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:18.014269 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-418e7e1d-63ea-4272-8212-57a8a614b090 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:18.015142 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-418e7e1d-63ea-4272-8212-57a8a614b090 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:18.015668 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-418e7e1d-63ea-4272-8212-57a8a614b090 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:18.148376 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-418e7e1d-63ea-4272-8212-57a8a614b090 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:18.156550 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-418e7e1d-63ea-4272-8212-57a8a614b090 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1575 microversion: 2.1 time: 0.155075 Jun 16 15:03:18.157106 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 511/1023] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:18 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:19.174654 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b2d2c032-076f-4285-a0db-161b2487cf16 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:19.175337 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b2d2c032-076f-4285-a0db-161b2487cf16 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:19.181856 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b2d2c032-076f-4285-a0db-161b2487cf16 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:19.182298 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b2d2c032-076f-4285-a0db-161b2487cf16 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:19.183049 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b2d2c032-076f-4285-a0db-161b2487cf16 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:19.183469 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b2d2c032-076f-4285-a0db-161b2487cf16 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:19.319336 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b2d2c032-076f-4285-a0db-161b2487cf16 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:19.327134 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b2d2c032-076f-4285-a0db-161b2487cf16 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1575 microversion: 2.1 time: 0.157937 Jun 16 15:03:19.327720 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 513/1024] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:19 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:03:20.343424 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-84ac1280-6a2f-4241-8c7e-97c6c8fae524 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:20.344816 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-84ac1280-6a2f-4241-8c7e-97c6c8fae524 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:20.351475 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-84ac1280-6a2f-4241-8c7e-97c6c8fae524 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:20.351962 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-84ac1280-6a2f-4241-8c7e-97c6c8fae524 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:20.352728 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-84ac1280-6a2f-4241-8c7e-97c6c8fae524 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:20.353160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-84ac1280-6a2f-4241-8c7e-97c6c8fae524 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:20.535660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-84ac1280-6a2f-4241-8c7e-97c6c8fae524 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:20.544450 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-84ac1280-6a2f-4241-8c7e-97c6c8fae524 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1575 microversion: 2.1 time: 0.205268 Jun 16 15:03:20.545006 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 512/1025] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:20 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1575 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:21.561281 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-801ff61d-356a-4437-b32b-08322f3cdfd6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:21.562199 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-801ff61d-356a-4437-b32b-08322f3cdfd6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:21.569084 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-801ff61d-356a-4437-b32b-08322f3cdfd6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:21.569735 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-801ff61d-356a-4437-b32b-08322f3cdfd6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:21.570733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-801ff61d-356a-4437-b32b-08322f3cdfd6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:21.571170 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-801ff61d-356a-4437-b32b-08322f3cdfd6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:21.719459 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-801ff61d-356a-4437-b32b-08322f3cdfd6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:21.727312 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-801ff61d-356a-4437-b32b-08322f3cdfd6 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1562 microversion: 2.1 time: 0.169894 Jun 16 15:03:21.727916 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 514/1026] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:21 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:39.426851 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4ebf7bf8-278c-490f-aaa0-075d94b42309 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:39.427838 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4ebf7bf8-278c-490f-aaa0-075d94b42309 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:39.430682 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:39.431391 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=20 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:39.438160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4ebf7bf8-278c-490f-aaa0-075d94b42309 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:39.438617 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4ebf7bf8-278c-490f-aaa0-075d94b42309 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:39.439388 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4ebf7bf8-278c-490f-aaa0-075d94b42309 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:39.439962 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4ebf7bf8-278c-490f-aaa0-075d94b42309 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:39.475999 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4ebf7bf8-278c-490f-aaa0-075d94b42309 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052979 Jun 16 15:03:39.476560 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 513/1027] 10.222.0.76 () {60 vars in 1342 bytes} [Thu Jun 16 15:03:39 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:39.548081 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-2108d0f5-752c-4850-8b6a-a3de2f3b7d8f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:39.548606 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-2108d0f5-752c-4850-8b6a-a3de2f3b7d8f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:39.551260 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:39.551920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=51 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:39.559059 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2108d0f5-752c-4850-8b6a-a3de2f3b7d8f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:39.559518 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2108d0f5-752c-4850-8b6a-a3de2f3b7d8f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:39.560265 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2108d0f5-752c-4850-8b6a-a3de2f3b7d8f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:39.560717 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2108d0f5-752c-4850-8b6a-a3de2f3b7d8f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:39.589312 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-2108d0f5-752c-4850-8b6a-a3de2f3b7d8f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Going to try to terminate instance {{(pid=117443) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:03:39.672962 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-2108d0f5-752c-4850-8b6a-a3de2f3b7d8f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 204 len: 0 microversion: 2.20 time: 0.129215 Jun 16 15:03:39.673565 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 515/1028] 10.222.0.76 () {60 vars in 1279 bytes} [Thu Jun 16 15:03:39 2022] DELETE /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 15:03:39.683012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9526cc47-62c6-49ed-bfd1-f8a663c93d5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:39.684147 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9526cc47-62c6-49ed-bfd1-f8a663c93d5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:39.690209 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9526cc47-62c6-49ed-bfd1-f8a663c93d5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:39.690650 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9526cc47-62c6-49ed-bfd1-f8a663c93d5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:39.691406 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9526cc47-62c6-49ed-bfd1-f8a663c93d5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:39.691867 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9526cc47-62c6-49ed-bfd1-f8a663c93d5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:39.832765 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9526cc47-62c6-49ed-bfd1-f8a663c93d5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:39.840807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9526cc47-62c6-49ed-bfd1-f8a663c93d5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:39.842308 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9526cc47-62c6-49ed-bfd1-f8a663c93d5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:39.843460 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9526cc47-62c6-49ed-bfd1-f8a663c93d5f tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1721 microversion: 2.20 time: 0.165438 Jun 16 15:03:39.844040 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 514/1029] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:39 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:03:40.862300 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-fca70e14-7fac-4493-900d-8c5fda03b1e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:40.862995 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-fca70e14-7fac-4493-900d-8c5fda03b1e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:40.869645 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fca70e14-7fac-4493-900d-8c5fda03b1e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:40.870097 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fca70e14-7fac-4493-900d-8c5fda03b1e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:40.870857 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fca70e14-7fac-4493-900d-8c5fda03b1e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:40.871289 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fca70e14-7fac-4493-900d-8c5fda03b1e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:41.004915 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fca70e14-7fac-4493-900d-8c5fda03b1e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:41.012830 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fca70e14-7fac-4493-900d-8c5fda03b1e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:41.014316 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fca70e14-7fac-4493-900d-8c5fda03b1e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:41.015463 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-fca70e14-7fac-4493-900d-8c5fda03b1e8 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1721 microversion: 2.20 time: 0.157416 Jun 16 15:03:41.016115 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 516/1030] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:40 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:03:42.033307 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c8e541f7-79fe-4e3e-a510-105578d3ecb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:42.034251 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c8e541f7-79fe-4e3e-a510-105578d3ecb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:42.041555 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c8e541f7-79fe-4e3e-a510-105578d3ecb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:42.042030 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c8e541f7-79fe-4e3e-a510-105578d3ecb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:42.042751 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c8e541f7-79fe-4e3e-a510-105578d3ecb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:42.043968 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c8e541f7-79fe-4e3e-a510-105578d3ecb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:42.111386 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c8e541f7-79fe-4e3e-a510-105578d3ecb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:42.120268 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c8e541f7-79fe-4e3e-a510-105578d3ecb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:42.122382 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c8e541f7-79fe-4e3e-a510-105578d3ecb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c31b2060e83410482ac2bef20b0556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2893d1739fb84d7c8a2311ef4aab72e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:42.123529 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c8e541f7-79fe-4e3e-a510-105578d3ecb9 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 200 len: 1654 microversion: 2.20 time: 0.094318 Jun 16 15:03:42.124107 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 515/1031] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:42 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 1654 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:03:42.363053 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-c3414607-bf0d-40cf-bd8a-ed76e000d21c req-024a3cb1-df6b-4607-ada5-85ff7f57452a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c044f7d0-a298-4c42-9a40-2bc494b1cdc9", "name": "network-vif-deleted", "tag": "ee7ef7f3-bf69-418d-ace6-a422233a0197"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:03:42.376686 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-c3414607-bf0d-40cf-bd8a-ed76e000d21c req-024a3cb1-df6b-4607-ada5-85ff7f57452a service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:42.377424 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-c3414607-bf0d-40cf-bd8a-ed76e000d21c req-024a3cb1-df6b-4607-ada5-85ff7f57452a service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:42.402865 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-c3414607-bf0d-40cf-bd8a-ed76e000d21c req-024a3cb1-df6b-4607-ada5-85ff7f57452a service nova] Creating event network-vif-deleted:ee7ef7f3-bf69-418d-ace6-a422233a0197 for instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 on hv-cinder-83716 Jun 16 15:03:42.414265 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-c3414607-bf0d-40cf-bd8a-ed76e000d21c req-024a3cb1-df6b-4607-ada5-85ff7f57452a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055490 Jun 16 15:03:42.415247 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 517/1032] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:03:43.142795 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ee841862-f768-4b89-9ebb-b72b38625b52 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:43.143404 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ee841862-f768-4b89-9ebb-b72b38625b52 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:43.150303 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ee841862-f768-4b89-9ebb-b72b38625b52 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:43.150755 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ee841862-f768-4b89-9ebb-b72b38625b52 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:43.154736 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ee841862-f768-4b89-9ebb-b72b38625b52 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:43.155184 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ee841862-f768-4b89-9ebb-b72b38625b52 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:43.169739 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-ee841862-f768-4b89-9ebb-b72b38625b52 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] HTTP exception thrown: Instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 could not be found. Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ee841862-f768-4b89-9ebb-b72b38625b52 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Request method failure captured: Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 HTTP/1.1 Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0R2SaucNKuBEMsqpUPtCvjPUACFEzNeGRC5YUG4uCtrcNNfE-c8xrbSIIcW4b4_202tmbvL4nbAZntLL6MXwc-Z_QzVhpmWmEbmNd1N5Rxjm5z5fgbZAVHR2tdXP2kBpyMlLMHxYY-s_Sv1p-FB9b3r73viHEW5wEt1W-3iDP8gcR4 Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 2893d1739fb84d7c8a2311ef4aab72e5 Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-222833261 Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:03:43.171466 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:03:43.173113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:03:43.173113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeShelveTestJSON-222833261 Jun 16 15:03:43.173113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 2893d1739fb84d7c8a2311ef4aab72e5 Jun 16 15:03:43.173113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-222833261 Jun 16 15:03:43.173113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeShelveTestJSON-222833261-project Jun 16 15:03:43.173113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:03:43.173113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:03:43.173113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 7c31b2060e83410482ac2bef20b0556e Jun 16 15:03:43.173113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeShelveTestJSON-222833261-project Jun 16 15:03:43.173113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:03:43.173113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 could not be found. Jun 16 15:03:43.173113 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': 'c044f7d0-a298-4c42-9a40-2bc494b1cdc9'} Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 could not be found. Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:03:43.174047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:03:43.175663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:03:43.175663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:03:43.175663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:03:43.175663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:03:43.175663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:03:43.175663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:03:43.175663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:03:43.175663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 could not be found. Jun 16 15:03:43.175663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:43.175663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:43.175663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:43.175663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:43.175663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:43.175663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:43.175663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:03:43.175663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:03:43.175663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 could not be found. Jun 16 15:03:43.175663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:43.177198 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ee841862-f768-4b89-9ebb-b72b38625b52 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Returning 404 to user: Instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:03:43.177198 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ee841862-f768-4b89-9ebb-b72b38625b52 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 404 len: 111 microversion: 2.20 time: 0.034514 Jun 16 15:03:43.177198 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 516/1033] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:43 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 15:03:43.182409 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8f13d21a-4725-4437-97d8-bc7fc7ce6c75 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '.version_select at 0x7f33e1308ee0>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:43.202726 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8f13d21a-4725-4437-97d8-bc7fc7ce6c75 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-421875907" status: 204 len: 0 microversion: 2.20 time: 0.024376 Jun 16 15:03:43.203335 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 518/1034] 10.222.0.76 () {60 vars in 1258 bytes} [Thu Jun 16 15:03:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-421875907 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 15:03:44.994183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1394006c-1d8a-4872-94ff-7cbd8dcaab24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:44.994665 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1394006c-1d8a-4872-94ff-7cbd8dcaab24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:45.001232 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1394006c-1d8a-4872-94ff-7cbd8dcaab24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:45.001686 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1394006c-1d8a-4872-94ff-7cbd8dcaab24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:45.002444 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1394006c-1d8a-4872-94ff-7cbd8dcaab24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:45.002880 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1394006c-1d8a-4872-94ff-7cbd8dcaab24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:45.016860 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-1394006c-1d8a-4872-94ff-7cbd8dcaab24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] HTTP exception thrown: Instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 could not be found. Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1394006c-1d8a-4872-94ff-7cbd8dcaab24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Request method failure captured: Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: DELETE /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 HTTP/1.1 Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0R2SaucNKuBEMsqpUPtCvjPUACFEzNeGRC5YUG4uCtrcNNfE-c8xrbSIIcW4b4_202tmbvL4nbAZntLL6MXwc-Z_QzVhpmWmEbmNd1N5Rxjm5z5fgbZAVHR2tdXP2kBpyMlLMHxYY-s_Sv1p-FB9b3r73viHEW5wEt1W-3iDP8gcR4 Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 2893d1739fb84d7c8a2311ef4aab72e5 Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-222833261 Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:03:45.018439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:03:45.020086 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:03:45.020086 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeShelveTestJSON-222833261 Jun 16 15:03:45.020086 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 2893d1739fb84d7c8a2311ef4aab72e5 Jun 16 15:03:45.020086 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-222833261 Jun 16 15:03:45.020086 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeShelveTestJSON-222833261-project Jun 16 15:03:45.020086 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:03:45.020086 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:03:45.020086 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 7c31b2060e83410482ac2bef20b0556e Jun 16 15:03:45.020086 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeShelveTestJSON-222833261-project Jun 16 15:03:45.020086 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:03:45.020086 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 could not be found. Jun 16 15:03:45.020086 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': 'c044f7d0-a298-4c42-9a40-2bc494b1cdc9'} Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 could not be found. Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:03:45.021183 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 could not be found. Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 could not be found. Jun 16 15:03:45.022624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:45.024214 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1394006c-1d8a-4872-94ff-7cbd8dcaab24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Returning 404 to user: Instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:03:45.024214 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1394006c-1d8a-4872-94ff-7cbd8dcaab24 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 404 len: 111 microversion: 2.20 time: 0.029546 Jun 16 15:03:45.024214 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 517/1035] 10.222.0.76 () {60 vars in 1279 bytes} [Thu Jun 16 15:03:44 2022] DELETE /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 15:03:45.029540 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-159d9d0e-5ae7-49fc-889e-4682d949ec3c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:45.030258 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-159d9d0e-5ae7-49fc-889e-4682d949ec3c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: c044f7d0-a298-4c42-9a40-2bc494b1cdc9] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:45.037669 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-159d9d0e-5ae7-49fc-889e-4682d949ec3c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:45.038503 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-159d9d0e-5ae7-49fc-889e-4682d949ec3c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:45.039369 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-159d9d0e-5ae7-49fc-889e-4682d949ec3c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:45.039914 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-159d9d0e-5ae7-49fc-889e-4682d949ec3c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:45.054034 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-159d9d0e-5ae7-49fc-889e-4682d949ec3c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] HTTP exception thrown: Instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 could not be found. Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-159d9d0e-5ae7-49fc-889e-4682d949ec3c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Request method failure captured: Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 HTTP/1.1 Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0R2SaucNKuBEMsqpUPtCvjPUACFEzNeGRC5YUG4uCtrcNNfE-c8xrbSIIcW4b4_202tmbvL4nbAZntLL6MXwc-Z_QzVhpmWmEbmNd1N5Rxjm5z5fgbZAVHR2tdXP2kBpyMlLMHxYY-s_Sv1p-FB9b3r73viHEW5wEt1W-3iDP8gcR4 Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 2893d1739fb84d7c8a2311ef4aab72e5 Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-222833261 Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 15:03:45.055723 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 15:03:45.057359 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:03:45.057359 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-AttachVolumeShelveTestJSON-222833261 Jun 16 15:03:45.057359 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 2893d1739fb84d7c8a2311ef4aab72e5 Jun 16 15:03:45.057359 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-222833261 Jun 16 15:03:45.057359 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-AttachVolumeShelveTestJSON-222833261-project Jun 16 15:03:45.057359 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 15:03:45.057359 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 15:03:45.057359 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: 7c31b2060e83410482ac2bef20b0556e Jun 16 15:03:45.057359 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-AttachVolumeShelveTestJSON-222833261-project Jun 16 15:03:45.057359 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 15:03:45.057359 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 could not be found. Jun 16 15:03:45.057359 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': 'c044f7d0-a298-4c42-9a40-2bc494b1cdc9'} Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 could not be found. Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:03:45.058362 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:03:45.059959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:03:45.059959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:03:45.059959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:03:45.059959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:03:45.059959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:03:45.059959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:03:45.059959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:03:45.059959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 could not be found. Jun 16 15:03:45.059959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:45.059959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:45.059959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:45.059959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:45.059959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:45.059959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:45.059959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:03:45.059959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:03:45.059959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 could not be found. Jun 16 15:03:45.059959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:45.061238 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-159d9d0e-5ae7-49fc-889e-4682d949ec3c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Returning 404 to user: Instance c044f7d0-a298-4c42-9a40-2bc494b1cdc9 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:03:45.061238 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-159d9d0e-5ae7-49fc-889e-4682d949ec3c tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9" status: 404 len: 111 microversion: 2.20 time: 0.032603 Jun 16 15:03:45.061238 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 519/1036] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:45 2022] GET /compute/v2.1/servers/c044f7d0-a298-4c42-9a40-2bc494b1cdc9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 15:03:46.200218 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6cff8128-0370-48b4-bd07-fd1c61321265 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:46.200731 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6cff8128-0370-48b4-bd07-fd1c61321265 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:46.207458 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6cff8128-0370-48b4-bd07-fd1c61321265 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:46.207957 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6cff8128-0370-48b4-bd07-fd1c61321265 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:46.208765 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6cff8128-0370-48b4-bd07-fd1c61321265 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:46.209214 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6cff8128-0370-48b4-bd07-fd1c61321265 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:46.223219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-6cff8128-0370-48b4-bd07-fd1c61321265 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] HTTP exception thrown: Instance 663488be-459f-4a58-aa1c-82be04813a2f could not be found. Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6cff8128-0370-48b4-bd07-fd1c61321265 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Request method failure captured: Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: DELETE /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f HTTP/1.1 Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0R2SaucNKuBEMsqpUPtCvjPUACFEzNeGRC5YUG4uCtrcNNfE-c8xrbSIIcW4b4_202tmbvL4nbAZntLL6MXwc-Z_QzVhpmWmEbmNd1N5Rxjm5z5fgbZAVHR2tdXP2kBpyMlLMHxYY-s_Sv1p-FB9b3r73viHEW5wEt1W-3iDP8gcR4 Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 2893d1739fb84d7c8a2311ef4aab72e5 Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-222833261 Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:03:46.224853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:03:46.226396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:03:46.226396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeShelveTestJSON-222833261 Jun 16 15:03:46.226396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 2893d1739fb84d7c8a2311ef4aab72e5 Jun 16 15:03:46.226396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-222833261 Jun 16 15:03:46.226396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeShelveTestJSON-222833261-project Jun 16 15:03:46.226396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:03:46.226396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:03:46.226396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: 7c31b2060e83410482ac2bef20b0556e Jun 16 15:03:46.226396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeShelveTestJSON-222833261-project Jun 16 15:03:46.226396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:03:46.226396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance 663488be-459f-4a58-aa1c-82be04813a2f could not be found. Jun 16 15:03:46.226396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': '663488be-459f-4a58-aa1c-82be04813a2f'} Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 663488be-459f-4a58-aa1c-82be04813a2f could not be found. Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:03:46.227275 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 663488be-459f-4a58-aa1c-82be04813a2f could not be found. Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 663488be-459f-4a58-aa1c-82be04813a2f could not be found. Jun 16 15:03:46.228853 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:03:46.230359 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6cff8128-0370-48b4-bd07-fd1c61321265 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Returning 404 to user: Instance 663488be-459f-4a58-aa1c-82be04813a2f could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:03:46.230359 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6cff8128-0370-48b4-bd07-fd1c61321265 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "DELETE /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 404 len: 111 microversion: 2.20 time: 0.029949 Jun 16 15:03:46.230359 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 518/1037] 10.222.0.76 () {60 vars in 1279 bytes} [Thu Jun 16 15:03:46 2022] DELETE /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 15:03:46.242077 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-48a322f5-8d75-4717-aa6c-ff734cca0076 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:46.242898 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-48a322f5-8d75-4717-aa6c-ff734cca0076 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] [instance: 663488be-459f-4a58-aa1c-82be04813a2f] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:46.250407 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-48a322f5-8d75-4717-aa6c-ff734cca0076 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:46.250953 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-48a322f5-8d75-4717-aa6c-ff734cca0076 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:46.251761 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-48a322f5-8d75-4717-aa6c-ff734cca0076 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:46.252197 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-48a322f5-8d75-4717-aa6c-ff734cca0076 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:46.266159 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-48a322f5-8d75-4717-aa6c-ff734cca0076 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] HTTP exception thrown: Instance 663488be-459f-4a58-aa1c-82be04813a2f could not be found. Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-48a322f5-8d75-4717-aa6c-ff734cca0076 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Request method failure captured: Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f HTTP/1.1 Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0R2SaucNKuBEMsqpUPtCvjPUACFEzNeGRC5YUG4uCtrcNNfE-c8xrbSIIcW4b4_202tmbvL4nbAZntLL6MXwc-Z_QzVhpmWmEbmNd1N5Rxjm5z5fgbZAVHR2tdXP2kBpyMlLMHxYY-s_Sv1p-FB9b3r73viHEW5wEt1W-3iDP8gcR4 Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 2893d1739fb84d7c8a2311ef4aab72e5 Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-222833261 Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 15:03:46.267781 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 15:03:46.269236 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2893d1739fb84d7c8a2311ef4aab72e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:03:46.269236 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-AttachVolumeShelveTestJSON-222833261 Jun 16 15:03:46.269236 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 2893d1739fb84d7c8a2311ef4aab72e5 Jun 16 15:03:46.269236 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-222833261 Jun 16 15:03:46.269236 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-AttachVolumeShelveTestJSON-222833261-project Jun 16 15:03:46.269236 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 15:03:46.269236 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 15:03:46.269236 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: 7c31b2060e83410482ac2bef20b0556e Jun 16 15:03:46.269236 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-AttachVolumeShelveTestJSON-222833261-project Jun 16 15:03:46.269236 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 15:03:46.269236 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance 663488be-459f-4a58-aa1c-82be04813a2f could not be found. Jun 16 15:03:46.269236 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': '663488be-459f-4a58-aa1c-82be04813a2f'} Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 663488be-459f-4a58-aa1c-82be04813a2f could not be found. Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:03:46.270132 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:03:46.271659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:03:46.271659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:03:46.271659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:03:46.271659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:03:46.271659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:03:46.271659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:03:46.271659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:03:46.271659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 663488be-459f-4a58-aa1c-82be04813a2f could not be found. Jun 16 15:03:46.271659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:46.271659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:03:46.271659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:46.271659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:03:46.271659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:03:46.271659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:03:46.271659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:03:46.271659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:03:46.271659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 663488be-459f-4a58-aa1c-82be04813a2f could not be found. Jun 16 15:03:46.271659 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:03:46.273065 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-48a322f5-8d75-4717-aa6c-ff734cca0076 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] Returning 404 to user: Instance 663488be-459f-4a58-aa1c-82be04813a2f could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:03:46.273065 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-48a322f5-8d75-4717-aa6c-ff734cca0076 tempest-AttachVolumeShelveTestJSON-222833261 tempest-AttachVolumeShelveTestJSON-222833261-project] 10.222.0.76 "GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f" status: 404 len: 111 microversion: 2.20 time: 0.033390 Jun 16 15:03:46.273065 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 520/1038] 10.222.0.76 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:46 2022] GET /compute/v2.1/servers/663488be-459f-4a58-aa1c-82be04813a2f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 15:03:55.114052 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b75fff44-0433-40c0-a31e-24b2cd430e30 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Action: 'create', calling method: .version_select at 0x7f33e1401ee0>, body: {"keypair": {"name": "tempest-keypair-367935529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUYN3gTt2P1Jr2GMiIZ2YqAaBVDX58K4HvUBXtrD15LtQGrhQ0eUJxYnrFcSKuQ+venGnUsxI0/T7BLNkWiA4k4Cx1fW+MRAqLTof58D+qteAnWquGW6ufj6yRB68A97A=="}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:03:55.129857 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-b75fff44-0433-40c0-a31e-24b2cd430e30 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Getting quotas for project 1e2ff2a55903449bb4c5364e64645931. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:03:55.134290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-b75fff44-0433-40c0-a31e-24b2cd430e30 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Getting quotas for user b8bd17e43c3a4c22bedf4d8011a6f064 and project 1e2ff2a55903449bb4c5364e64645931. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:03:55.166257 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b75fff44-0433-40c0-a31e-24b2cd430e30 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.169093 Jun 16 15:03:55.167093 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 519/1039] 10.222.0.76 () {60 vars in 1158 bytes} [Thu Jun 16 15:03:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:03:56.641810 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-70f1e779-ebd2-4b24-b4c9-260f959483bd tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-716046640", "imageRef": "f2f37ffa-db20-478d-84c0-b429a987933c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef31a3e7-e507-4708-8c9e-527bbd733b76"}], "security_groups": [{"name": "tempest-securitygroup--1007062315"}], "key_name": "tempest-keypair-367935529", "user_data": "}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:03:56.648814 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:56.649461 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:56.764293 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.network.neutron [None req-70f1e779-ebd2-4b24-b4c9-260f959483bd tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] validate_networks() for [('ef31a3e7-e507-4708-8c9e-527bbd733b76', None, None, None, None, None)] {{(pid=117443) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:03:57.165662 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-70f1e779-ebd2-4b24-b4c9-260f959483bd tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Flavor limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:03:57.166289 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-70f1e779-ebd2-4b24-b4c9-260f959483bd tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Image limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:03:57.166769 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-70f1e779-ebd2-4b24-b4c9-260f959483bd tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Flavor pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:03:57.167183 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-70f1e779-ebd2-4b24-b4c9-260f959483bd tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Image pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:03:57.167627 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-70f1e779-ebd2-4b24-b4c9-260f959483bd tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:03:57.180737 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-70f1e779-ebd2-4b24-b4c9-260f959483bd tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:57.181207 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-70f1e779-ebd2-4b24-b4c9-260f959483bd tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:57.182287 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-70f1e779-ebd2-4b24-b4c9-260f959483bd tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:57.182736 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-70f1e779-ebd2-4b24-b4c9-260f959483bd tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:57.201354 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-70f1e779-ebd2-4b24-b4c9-260f959483bd tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Getting quotas for project 1e2ff2a55903449bb4c5364e64645931. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:03:57.205409 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-70f1e779-ebd2-4b24-b4c9-260f959483bd tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Getting quotas for user b8bd17e43c3a4c22bedf4d8011a6f064 and project 1e2ff2a55903449bb4c5364e64645931. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:03:57.217368 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-70f1e779-ebd2-4b24-b4c9-260f959483bd tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Going to run 1 instances... {{(pid=117443) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:03:57.219810 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-70f1e779-ebd2-4b24-b4c9-260f959483bd tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2f37ffa-db20-478d-84c0-b429a987933c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:03:57.268809 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-70f1e779-ebd2-4b24-b4c9-260f959483bd tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.631028 Jun 16 15:03:57.269776 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 521/1040] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 15:03:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 15:03:57.279906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-817e21a7-cb6e-462b-9025-b4bbc046a346 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:57.281125 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-817e21a7-cb6e-462b-9025-b4bbc046a346 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:57.284024 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=24 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:57.346196 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-817e21a7-cb6e-462b-9025-b4bbc046a346 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:57.354226 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-817e21a7-cb6e-462b-9025-b4bbc046a346 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1236 microversion: 2.1 time: 0.078621 Jun 16 15:03:57.364505 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 520/1041] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:57 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1236 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:58.372857 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-483f2445-fba7-4bd3-8150-c43bb2f492fe tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:58.373475 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-483f2445-fba7-4bd3-8150-c43bb2f492fe tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:58.389724 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-483f2445-fba7-4bd3-8150-c43bb2f492fe tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:58.390175 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-483f2445-fba7-4bd3-8150-c43bb2f492fe tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:58.390993 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-483f2445-fba7-4bd3-8150-c43bb2f492fe tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:58.391430 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-483f2445-fba7-4bd3-8150-c43bb2f492fe tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:58.476703 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-483f2445-fba7-4bd3-8150-c43bb2f492fe tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:58.486411 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-483f2445-fba7-4bd3-8150-c43bb2f492fe tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1288 microversion: 2.1 time: 0.118681 Jun 16 15:03:58.488053 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 522/1042] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:58 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1288 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:59.508753 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d499e4fe-d600-4fac-82f7-31eb72ef023b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:59.509773 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d499e4fe-d600-4fac-82f7-31eb72ef023b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:59.518630 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d499e4fe-d600-4fac-82f7-31eb72ef023b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:59.519302 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d499e4fe-d600-4fac-82f7-31eb72ef023b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:59.520528 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d499e4fe-d600-4fac-82f7-31eb72ef023b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:59.521256 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d499e4fe-d600-4fac-82f7-31eb72ef023b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:59.707330 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d499e4fe-d600-4fac-82f7-31eb72ef023b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:59.716269 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d499e4fe-d600-4fac-82f7-31eb72ef023b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1362 microversion: 2.1 time: 0.214004 Jun 16 15:03:59.717149 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 521/1043] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:59 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:00.307489 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-6a78a585-4b17-4610-b9c9-0fca796a93ff req-651f2688-bbdd-4a04-917a-f4d9d62b440d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80fc06fb-d5ab-4b9e-bdc2-bb043f52da15", "tag": "0cb8ad0c-d793-4e45-8b3b-d1eca6b77276"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:00.321628 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-6a78a585-4b17-4610-b9c9-0fca796a93ff req-651f2688-bbdd-4a04-917a-f4d9d62b440d service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:00.322616 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-6a78a585-4b17-4610-b9c9-0fca796a93ff req-651f2688-bbdd-4a04-917a-f4d9d62b440d service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:00.353470 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-6a78a585-4b17-4610-b9c9-0fca796a93ff req-651f2688-bbdd-4a04-917a-f4d9d62b440d service nova] Creating event network-changed:0cb8ad0c-d793-4e45-8b3b-d1eca6b77276 for instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 on hv-cinder-83716 Jun 16 15:04:00.361314 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-6a78a585-4b17-4610-b9c9-0fca796a93ff req-651f2688-bbdd-4a04-917a-f4d9d62b440d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058486 Jun 16 15:04:00.362228 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 523/1044] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:00.735798 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-afb2a1f2-67de-4a5e-92d1-e2ea28dd9ab8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:00.737076 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-afb2a1f2-67de-4a5e-92d1-e2ea28dd9ab8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:00.743404 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-afb2a1f2-67de-4a5e-92d1-e2ea28dd9ab8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:00.744048 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-afb2a1f2-67de-4a5e-92d1-e2ea28dd9ab8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:00.745085 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-afb2a1f2-67de-4a5e-92d1-e2ea28dd9ab8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:00.746406 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-afb2a1f2-67de-4a5e-92d1-e2ea28dd9ab8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:00.887823 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-afb2a1f2-67de-4a5e-92d1-e2ea28dd9ab8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:00.895244 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-afb2a1f2-67de-4a5e-92d1-e2ea28dd9ab8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1362 microversion: 2.1 time: 0.165417 Jun 16 15:04:00.895822 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 522/1045] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:00 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:01.913130 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-86ce0782-accb-4b32-892f-b8e90cad02c2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:01.913741 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-86ce0782-accb-4b32-892f-b8e90cad02c2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:01.921384 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-86ce0782-accb-4b32-892f-b8e90cad02c2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:01.921839 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-86ce0782-accb-4b32-892f-b8e90cad02c2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:01.922614 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-86ce0782-accb-4b32-892f-b8e90cad02c2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:01.923061 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-86ce0782-accb-4b32-892f-b8e90cad02c2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:02.065914 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-86ce0782-accb-4b32-892f-b8e90cad02c2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:02.073620 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-86ce0782-accb-4b32-892f-b8e90cad02c2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1362 microversion: 2.1 time: 0.165084 Jun 16 15:04:02.074392 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 524/1046] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:01 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:03.094048 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d59ff42b-6aa9-46ad-ae6e-ae1ef294b3db tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:03.094687 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d59ff42b-6aa9-46ad-ae6e-ae1ef294b3db tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:03.102115 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d59ff42b-6aa9-46ad-ae6e-ae1ef294b3db tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:03.102511 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d59ff42b-6aa9-46ad-ae6e-ae1ef294b3db tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:03.103532 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d59ff42b-6aa9-46ad-ae6e-ae1ef294b3db tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:03.104061 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d59ff42b-6aa9-46ad-ae6e-ae1ef294b3db tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:03.242613 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d59ff42b-6aa9-46ad-ae6e-ae1ef294b3db tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:03.254334 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d59ff42b-6aa9-46ad-ae6e-ae1ef294b3db tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1362 microversion: 2.1 time: 0.164282 Jun 16 15:04:03.254898 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 523/1047] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:03 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:04.270798 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c59a0ffa-06c1-43d7-b298-cf815943e88a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:04.271411 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c59a0ffa-06c1-43d7-b298-cf815943e88a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:04.278519 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c59a0ffa-06c1-43d7-b298-cf815943e88a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:04.278917 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c59a0ffa-06c1-43d7-b298-cf815943e88a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:04.279705 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c59a0ffa-06c1-43d7-b298-cf815943e88a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:04.280135 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c59a0ffa-06c1-43d7-b298-cf815943e88a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:04.412710 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c59a0ffa-06c1-43d7-b298-cf815943e88a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:04.420800 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c59a0ffa-06c1-43d7-b298-cf815943e88a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1362 microversion: 2.1 time: 0.154057 Jun 16 15:04:04.421359 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 525/1048] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:04 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:05.437905 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d280afb3-df85-40cf-98f9-649299222f57 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:05.438574 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d280afb3-df85-40cf-98f9-649299222f57 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:05.446200 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d280afb3-df85-40cf-98f9-649299222f57 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:05.446813 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d280afb3-df85-40cf-98f9-649299222f57 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:05.447824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d280afb3-df85-40cf-98f9-649299222f57 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:05.448266 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d280afb3-df85-40cf-98f9-649299222f57 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:05.471099 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-13d920ae-7dac-4224-86f5-0a99fc4cc555 req-b80b47b6-991b-4cae-bf2b-2e673642bdf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80fc06fb-d5ab-4b9e-bdc2-bb043f52da15", "name": "network-vif-plugged", "status": "completed", "tag": "0cb8ad0c-d793-4e45-8b3b-d1eca6b77276"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:05.486775 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-13d920ae-7dac-4224-86f5-0a99fc4cc555 req-b80b47b6-991b-4cae-bf2b-2e673642bdf5 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:05.487292 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-13d920ae-7dac-4224-86f5-0a99fc4cc555 req-b80b47b6-991b-4cae-bf2b-2e673642bdf5 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:05.499929 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-13d920ae-7dac-4224-86f5-0a99fc4cc555 req-b80b47b6-991b-4cae-bf2b-2e673642bdf5 service nova] Creating event network-vif-plugged:0cb8ad0c-d793-4e45-8b3b-d1eca6b77276 for instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 on hv-cinder-83716 Jun 16 15:04:05.505824 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-13d920ae-7dac-4224-86f5-0a99fc4cc555 req-b80b47b6-991b-4cae-bf2b-2e673642bdf5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043525 Jun 16 15:04:05.506988 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 526/1049] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:04:05.628159 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d280afb3-df85-40cf-98f9-649299222f57 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:05.638574 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d280afb3-df85-40cf-98f9-649299222f57 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1362 microversion: 2.1 time: 0.205202 Jun 16 15:04:05.639360 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 524/1050] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:05 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:06.655666 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-83b79c5d-1130-43b4-aaef-5520ad26d971 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:06.656369 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-83b79c5d-1130-43b4-aaef-5520ad26d971 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:06.663059 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-83b79c5d-1130-43b4-aaef-5520ad26d971 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:06.663598 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-83b79c5d-1130-43b4-aaef-5520ad26d971 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:06.664444 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-83b79c5d-1130-43b4-aaef-5520ad26d971 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:06.664876 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-83b79c5d-1130-43b4-aaef-5520ad26d971 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:06.797143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-83b79c5d-1130-43b4-aaef-5520ad26d971 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:06.804549 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-83b79c5d-1130-43b4-aaef-5520ad26d971 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1362 microversion: 2.1 time: 0.153358 Jun 16 15:04:06.805111 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 527/1051] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:06 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:07.822543 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-32a99287-523f-4754-b752-0734996cd292 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:07.823186 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-32a99287-523f-4754-b752-0734996cd292 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:07.826085 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=6 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:07.831628 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-32a99287-523f-4754-b752-0734996cd292 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:07.832106 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-32a99287-523f-4754-b752-0734996cd292 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:07.832873 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-32a99287-523f-4754-b752-0734996cd292 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:07.833311 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-32a99287-523f-4754-b752-0734996cd292 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:07.959021 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-32a99287-523f-4754-b752-0734996cd292 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:07.966421 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-32a99287-523f-4754-b752-0734996cd292 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1362 microversion: 2.1 time: 0.148045 Jun 16 15:04:07.966972 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 525/1052] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:07 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:08.983476 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ff2bd6cc-f707-449d-bef5-2f4b3e5ee60a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:08.984116 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ff2bd6cc-f707-449d-bef5-2f4b3e5ee60a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:08.986076 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=2 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:08.986756 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=6 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:08.993698 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ff2bd6cc-f707-449d-bef5-2f4b3e5ee60a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:08.994151 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ff2bd6cc-f707-449d-bef5-2f4b3e5ee60a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:08.994912 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ff2bd6cc-f707-449d-bef5-2f4b3e5ee60a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:08.995353 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ff2bd6cc-f707-449d-bef5-2f4b3e5ee60a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:09.124463 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ff2bd6cc-f707-449d-bef5-2f4b3e5ee60a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:09.132151 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ff2bd6cc-f707-449d-bef5-2f4b3e5ee60a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1362 microversion: 2.1 time: 0.153029 Jun 16 15:04:09.132716 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 528/1053] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:08 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:10.150082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e9a0c756-6b85-4879-b662-75c106e4e5ca tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:10.150601 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e9a0c756-6b85-4879-b662-75c106e4e5ca tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:10.153445 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:10.158975 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e9a0c756-6b85-4879-b662-75c106e4e5ca tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:10.159425 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e9a0c756-6b85-4879-b662-75c106e4e5ca tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:10.160294 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e9a0c756-6b85-4879-b662-75c106e4e5ca tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:10.160738 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e9a0c756-6b85-4879-b662-75c106e4e5ca tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:10.320358 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e9a0c756-6b85-4879-b662-75c106e4e5ca tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:10.328245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e9a0c756-6b85-4879-b662-75c106e4e5ca tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1547 microversion: 2.1 time: 0.182374 Jun 16 15:04:10.328809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 526/1054] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:10 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1547 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:10.344869 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-63d56fe5-d2d0-43cd-9145-11fd4339dcc0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:10.345394 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-63d56fe5-d2d0-43cd-9145-11fd4339dcc0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:10.352095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-63d56fe5-d2d0-43cd-9145-11fd4339dcc0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:10.352551 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-63d56fe5-d2d0-43cd-9145-11fd4339dcc0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:10.353309 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-63d56fe5-d2d0-43cd-9145-11fd4339dcc0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:10.353745 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-63d56fe5-d2d0-43cd-9145-11fd4339dcc0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:10.430471 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-63d56fe5-d2d0-43cd-9145-11fd4339dcc0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089495 Jun 16 15:04:10.431067 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 529/1055] 10.222.0.76 () {58 vars in 1274 bytes} [Thu Jun 16 15:04:10 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:11.358809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-35098c47-ee5d-4da8-9038-a13d0ace1fec req-6d2f9bf6-343b-4275-9a3d-01671e190d35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80fc06fb-d5ab-4b9e-bdc2-bb043f52da15", "tag": "0cb8ad0c-d793-4e45-8b3b-d1eca6b77276"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:11.361192 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-35098c47-ee5d-4da8-9038-a13d0ace1fec req-6d2f9bf6-343b-4275-9a3d-01671e190d35 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:11.361642 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-35098c47-ee5d-4da8-9038-a13d0ace1fec req-6d2f9bf6-343b-4275-9a3d-01671e190d35 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:11.373009 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-35098c47-ee5d-4da8-9038-a13d0ace1fec req-6d2f9bf6-343b-4275-9a3d-01671e190d35 service nova] Creating event network-changed:0cb8ad0c-d793-4e45-8b3b-d1eca6b77276 for instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 on hv-cinder-83716 Jun 16 15:04:11.382953 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-35098c47-ee5d-4da8-9038-a13d0ace1fec req-6d2f9bf6-343b-4275-9a3d-01671e190d35 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033864 Jun 16 15:04:11.383663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 527/1056] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:04:44.417938 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:44.423662 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-589086c6-e4cc-4f5e-b52e-f364ef70a141 req-f42fe2d9-0875-43ef-8f52-0b461e96017b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c", "tag": "a38f8fd7-717d-49a5-8003-162021ff7c63"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:44.427956 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:44.428608 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=38 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:44.431045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=40 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:44.435738 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d9d369fe-6e0c-4463-b67b-cb4999788cb4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:44.436236 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d9d369fe-6e0c-4463-b67b-cb4999788cb4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:44.443401 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d9d369fe-6e0c-4463-b67b-cb4999788cb4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:44.449705 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-589086c6-e4cc-4f5e-b52e-f364ef70a141 req-f42fe2d9-0875-43ef-8f52-0b461e96017b service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:44.450159 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-589086c6-e4cc-4f5e-b52e-f364ef70a141 req-f42fe2d9-0875-43ef-8f52-0b461e96017b service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:44.454335 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d9d369fe-6e0c-4463-b67b-cb4999788cb4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:44.455254 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d9d369fe-6e0c-4463-b67b-cb4999788cb4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:44.455721 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d9d369fe-6e0c-4463-b67b-cb4999788cb4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:44.467900 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-589086c6-e4cc-4f5e-b52e-f364ef70a141 req-f42fe2d9-0875-43ef-8f52-0b461e96017b service nova] Creating event network-changed:a38f8fd7-717d-49a5-8003-162021ff7c63 for instance 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c on hv-cinder-83716 Jun 16 15:04:44.473009 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-589086c6-e4cc-4f5e-b52e-f364ef70a141 req-f42fe2d9-0875-43ef-8f52-0b461e96017b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053325 Jun 16 15:04:44.473712 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 528/1057] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:44.485867 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d9d369fe-6e0c-4463-b67b-cb4999788cb4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Going to try to terminate instance {{(pid=117443) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:04:44.579661 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d9d369fe-6e0c-4463-b67b-cb4999788cb4 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "DELETE /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 204 len: 0 microversion: 2.1 time: 0.162873 Jun 16 15:04:44.580507 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 530/1058] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:04:44 2022] DELETE /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:04:44.589602 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-20194c62-2e8f-4cec-b41d-d71b3a5f825e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:44.590384 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-20194c62-2e8f-4cec-b41d-d71b3a5f825e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:44.597388 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-20194c62-2e8f-4cec-b41d-d71b3a5f825e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:44.597843 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-20194c62-2e8f-4cec-b41d-d71b3a5f825e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:44.598824 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-20194c62-2e8f-4cec-b41d-d71b3a5f825e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:44.599437 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-20194c62-2e8f-4cec-b41d-d71b3a5f825e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:44.746717 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-20194c62-2e8f-4cec-b41d-d71b3a5f825e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:44.754380 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-20194c62-2e8f-4cec-b41d-d71b3a5f825e tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1568 microversion: 2.1 time: 0.169192 Jun 16 15:04:44.754925 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 529/1059] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:44 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:45.773439 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-96f04325-1623-4c0f-a389-83dd03d7add0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:45.774194 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-96f04325-1623-4c0f-a389-83dd03d7add0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:45.781803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-96f04325-1623-4c0f-a389-83dd03d7add0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:45.782307 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-96f04325-1623-4c0f-a389-83dd03d7add0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:45.783177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-96f04325-1623-4c0f-a389-83dd03d7add0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:45.783651 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-96f04325-1623-4c0f-a389-83dd03d7add0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:45.929097 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-96f04325-1623-4c0f-a389-83dd03d7add0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:45.937226 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-96f04325-1623-4c0f-a389-83dd03d7add0 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1568 microversion: 2.1 time: 0.168509 Jun 16 15:04:45.937791 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 531/1060] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:45 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:46.891151 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-a1839f76-ea28-487a-a385-6e0d39b34144 req-9edad5e1-d744-4164-bb7b-9ca67704db09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c", "name": "network-vif-deleted", "tag": "a38f8fd7-717d-49a5-8003-162021ff7c63"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:46.901337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-a1839f76-ea28-487a-a385-6e0d39b34144 req-9edad5e1-d744-4164-bb7b-9ca67704db09 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:46.901782 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-a1839f76-ea28-487a-a385-6e0d39b34144 req-9edad5e1-d744-4164-bb7b-9ca67704db09 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:46.914361 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-a1839f76-ea28-487a-a385-6e0d39b34144 req-9edad5e1-d744-4164-bb7b-9ca67704db09 service nova] Creating event network-vif-deleted:a38f8fd7-717d-49a5-8003-162021ff7c63 for instance 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c on hv-cinder-83716 Jun 16 15:04:46.920912 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-a1839f76-ea28-487a-a385-6e0d39b34144 req-9edad5e1-d744-4164-bb7b-9ca67704db09 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033004 Jun 16 15:04:46.921283 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 530/1061] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:46.954814 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ef078555-c963-424a-8f4b-f21c24d69a8a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:46.955875 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ef078555-c963-424a-8f4b-f21c24d69a8a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:46.962639 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ef078555-c963-424a-8f4b-f21c24d69a8a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:46.963091 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ef078555-c963-424a-8f4b-f21c24d69a8a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:46.963930 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ef078555-c963-424a-8f4b-f21c24d69a8a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:46.964367 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ef078555-c963-424a-8f4b-f21c24d69a8a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:47.035779 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ef078555-c963-424a-8f4b-f21c24d69a8a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f943a0852a74679b940f20a87f15d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646f903869dd413b839067743f25278c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:47.044094 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ef078555-c963-424a-8f4b-f21c24d69a8a tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 200 len: 1218 microversion: 2.1 time: 0.093562 Jun 16 15:04:47.044669 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 532/1062] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:46 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:47.535706 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e542fc86-ff70-4697-b1ee-9a2768d6f1cc tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:47.536432 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e542fc86-ff70-4697-b1ee-9a2768d6f1cc tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:47.543178 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e542fc86-ff70-4697-b1ee-9a2768d6f1cc tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:47.543619 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e542fc86-ff70-4697-b1ee-9a2768d6f1cc tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:47.544467 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e542fc86-ff70-4697-b1ee-9a2768d6f1cc tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:47.544897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e542fc86-ff70-4697-b1ee-9a2768d6f1cc tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:47.569284 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e542fc86-ff70-4697-b1ee-9a2768d6f1cc tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15/ips" status: 200 len: 145 microversion: 2.1 time: 0.038470 Jun 16 15:04:47.570039 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 531/1063] 10.222.0.76 () {58 vars in 1247 bytes} [Thu Jun 16 15:04:47 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:48.061042 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8459e309-fcc6-4e3b-8342-a9fac9163094 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:48.061707 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-8459e309-fcc6-4e3b-8342-a9fac9163094 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] [instance: 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:48.068365 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8459e309-fcc6-4e3b-8342-a9fac9163094 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:48.068845 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8459e309-fcc6-4e3b-8342-a9fac9163094 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:48.069674 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8459e309-fcc6-4e3b-8342-a9fac9163094 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:48.070127 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8459e309-fcc6-4e3b-8342-a9fac9163094 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:48.084249 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-8459e309-fcc6-4e3b-8342-a9fac9163094 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] HTTP exception thrown: Instance 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c could not be found. Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8459e309-fcc6-4e3b-8342-a9fac9163094 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Request method failure captured: Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c HTTP/1.1 Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0VE4psDON0cnNJI_yDOETYEEDixEYs1m2mwY6Soj9ZgaKt9FDBnAd1Nv3ShMDnJeuRv2Ej9lkedBW4UpHTkIgO_SO8qNIMHHUo5aH3R4TudfqCy3WCe6xpBfRPGeP0__8OWlGnUs8qMmyeG66RDRuPMuTg6zQoQq99D-pkMbAhEX00 Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 646f903869dd413b839067743f25278c Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-TestShelveInstance-981112631 Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 15:04:48.086045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 15:04:48.087752 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/646f903869dd413b839067743f25278c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/646f903869dd413b839067743f25278c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_646f903869dd413b839067743f25278c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/646f903869dd413b839067743f25278c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:04:48.087752 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-TestShelveInstance-981112631 Jun 16 15:04:48.087752 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 646f903869dd413b839067743f25278c Jun 16 15:04:48.087752 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-TestShelveInstance-981112631 Jun 16 15:04:48.087752 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-TestShelveInstance-981112631-project Jun 16 15:04:48.087752 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 15:04:48.087752 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 15:04:48.087752 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: 9f943a0852a74679b940f20a87f15d71 Jun 16 15:04:48.087752 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-TestShelveInstance-981112631-project Jun 16 15:04:48.087752 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 15:04:48.087752 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c could not be found. Jun 16 15:04:48.087752 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': '9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c'} Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c could not be found. Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:04:48.089267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:04:48.090843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:04:48.090843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:04:48.090843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:04:48.090843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:04:48.090843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:04:48.090843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:04:48.090843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:04:48.090843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c could not be found. Jun 16 15:04:48.090843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:04:48.090843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:04:48.090843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:04:48.090843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:48.090843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:04:48.090843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:04:48.090843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:04:48.090843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:04:48.090843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c could not be found. Jun 16 15:04:48.090843 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:04:48.092299 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8459e309-fcc6-4e3b-8342-a9fac9163094 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Returning 404 to user: Instance 9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:04:48.092299 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8459e309-fcc6-4e3b-8342-a9fac9163094 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c" status: 404 len: 111 microversion: 2.1 time: 0.030857 Jun 16 15:04:48.092299 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 533/1064] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:48 2022] GET /compute/v2.1/servers/9e95b79e-a6fe-4f68-9e2f-4b56ceffdd4c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:04:48.250821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-dd55ae4f-23bf-410c-867c-09580e623362 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] Calling method '.version_select at 0x7f33e14299d0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:48.271927 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-dd55ae4f-23bf-410c-867c-09580e623362 tempest-TestShelveInstance-981112631 tempest-TestShelveInstance-981112631-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-293733398" status: 202 len: 0 microversion: 2.1 time: 0.025232 Jun 16 15:04:48.272882 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 532/1065] 10.222.0.76 () {58 vars in 1250 bytes} [Thu Jun 16 15:04:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-293733398 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:04:50.878014 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-2b0a94d7-9785-4324-b1fa-fbce40163335 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "813bfa58-d63a-44e3-aa1b-10f1a96b00ef"}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:50.879161 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-2b0a94d7-9785-4324-b1fa-fbce40163335 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:50.887366 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2b0a94d7-9785-4324-b1fa-fbce40163335 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:50.887908 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2b0a94d7-9785-4324-b1fa-fbce40163335 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:50.888763 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2b0a94d7-9785-4324-b1fa-fbce40163335 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:50.889346 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2b0a94d7-9785-4324-b1fa-fbce40163335 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:51.215947 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-2b0a94d7-9785-4324-b1fa-fbce40163335 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "POST /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.341196 Jun 16 15:04:51.217567 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 534/1066] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Jun 16 15:04:50 2022] POST /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:58.793175 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=14 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:58.793903 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:58.797992 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-958f3019-97ff-49a7-927b-f4802a591b9f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:58.805924 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-958f3019-97ff-49a7-927b-f4802a591b9f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:58.806373 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-958f3019-97ff-49a7-927b-f4802a591b9f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:58.865580 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-958f3019-97ff-49a7-927b-f4802a591b9f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Going to try to stop instance {{(pid=117444) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 15:04:58.906658 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-958f3019-97ff-49a7-927b-f4802a591b9f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "POST /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15/action" status: 202 len: 0 microversion: 2.1 time: 0.115068 Jun 16 15:04:58.907244 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 533/1067] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Jun 16 15:04:58 2022] POST /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:04:58.916853 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8f3f394c-f7b1-4121-a08f-be854cccf966 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:58.917553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-8f3f394c-f7b1-4121-a08f-be854cccf966 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:58.925135 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8f3f394c-f7b1-4121-a08f-be854cccf966 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:58.926220 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8f3f394c-f7b1-4121-a08f-be854cccf966 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:58.927471 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8f3f394c-f7b1-4121-a08f-be854cccf966 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:58.927953 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8f3f394c-f7b1-4121-a08f-be854cccf966 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:59.061750 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-8f3f394c-f7b1-4121-a08f-be854cccf966 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:59.069769 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8f3f394c-f7b1-4121-a08f-be854cccf966 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1722 microversion: 2.1 time: 0.157728 Jun 16 15:04:59.070329 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 535/1068] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:58 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:00.087353 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8c66a0f9-715c-417d-bbdf-de70564b6e1f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:00.088076 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8c66a0f9-715c-417d-bbdf-de70564b6e1f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:00.094352 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8c66a0f9-715c-417d-bbdf-de70564b6e1f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:00.094805 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8c66a0f9-715c-417d-bbdf-de70564b6e1f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:00.095563 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8c66a0f9-715c-417d-bbdf-de70564b6e1f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:00.096038 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8c66a0f9-715c-417d-bbdf-de70564b6e1f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:00.226070 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8c66a0f9-715c-417d-bbdf-de70564b6e1f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:00.234632 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8c66a0f9-715c-417d-bbdf-de70564b6e1f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1722 microversion: 2.1 time: 0.151967 Jun 16 15:05:00.235195 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 534/1069] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:00 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:01.252051 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d8f00c2e-bc00-40b4-a7d5-3a4117d0c8b4 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:01.252684 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d8f00c2e-bc00-40b4-a7d5-3a4117d0c8b4 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:01.259096 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d8f00c2e-bc00-40b4-a7d5-3a4117d0c8b4 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:01.259539 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d8f00c2e-bc00-40b4-a7d5-3a4117d0c8b4 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:01.260954 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d8f00c2e-bc00-40b4-a7d5-3a4117d0c8b4 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:01.261381 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d8f00c2e-bc00-40b4-a7d5-3a4117d0c8b4 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:01.390497 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d8f00c2e-bc00-40b4-a7d5-3a4117d0c8b4 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:01.399648 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d8f00c2e-bc00-40b4-a7d5-3a4117d0c8b4 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1722 microversion: 2.1 time: 0.151673 Jun 16 15:05:01.400235 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 536/1070] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:01 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:02.416182 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9a4adfb9-5150-4543-91a9-9deb141512f8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:02.416833 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9a4adfb9-5150-4543-91a9-9deb141512f8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:02.423290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9a4adfb9-5150-4543-91a9-9deb141512f8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:02.423773 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9a4adfb9-5150-4543-91a9-9deb141512f8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:02.424542 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9a4adfb9-5150-4543-91a9-9deb141512f8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:02.424980 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9a4adfb9-5150-4543-91a9-9deb141512f8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:02.552651 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9a4adfb9-5150-4543-91a9-9deb141512f8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:02.560593 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9a4adfb9-5150-4543-91a9-9deb141512f8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1722 microversion: 2.1 time: 0.148294 Jun 16 15:05:02.561145 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 535/1071] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:02 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:03.577381 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d24b2426-2e12-4bde-b3f6-3ca6a2c268b1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:03.577974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d24b2426-2e12-4bde-b3f6-3ca6a2c268b1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:03.584438 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d24b2426-2e12-4bde-b3f6-3ca6a2c268b1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:03.584876 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d24b2426-2e12-4bde-b3f6-3ca6a2c268b1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:03.585617 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d24b2426-2e12-4bde-b3f6-3ca6a2c268b1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:03.586039 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d24b2426-2e12-4bde-b3f6-3ca6a2c268b1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:03.712690 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d24b2426-2e12-4bde-b3f6-3ca6a2c268b1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:03.721180 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d24b2426-2e12-4bde-b3f6-3ca6a2c268b1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1722 microversion: 2.1 time: 0.147642 Jun 16 15:05:03.721743 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 537/1072] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:03 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:04.737985 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e3ffbb6e-e1ad-4756-ba0d-28908818f7d6 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:04.738540 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e3ffbb6e-e1ad-4756-ba0d-28908818f7d6 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:04.745576 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e3ffbb6e-e1ad-4756-ba0d-28908818f7d6 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:04.746025 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e3ffbb6e-e1ad-4756-ba0d-28908818f7d6 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:04.746784 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e3ffbb6e-e1ad-4756-ba0d-28908818f7d6 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:04.747220 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e3ffbb6e-e1ad-4756-ba0d-28908818f7d6 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:04.878558 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e3ffbb6e-e1ad-4756-ba0d-28908818f7d6 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:04.887085 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e3ffbb6e-e1ad-4756-ba0d-28908818f7d6 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1722 microversion: 2.1 time: 0.152993 Jun 16 15:05:04.887636 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 536/1073] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:04 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:05.905020 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4afa8981-32cd-452c-96f7-16fe2e19080d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:05.905633 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4afa8981-32cd-452c-96f7-16fe2e19080d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:05.912301 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4afa8981-32cd-452c-96f7-16fe2e19080d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:05.912753 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4afa8981-32cd-452c-96f7-16fe2e19080d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:05.913510 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4afa8981-32cd-452c-96f7-16fe2e19080d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:05.913940 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4afa8981-32cd-452c-96f7-16fe2e19080d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:06.044188 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4afa8981-32cd-452c-96f7-16fe2e19080d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:06.052312 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4afa8981-32cd-452c-96f7-16fe2e19080d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1722 microversion: 2.1 time: 0.151812 Jun 16 15:05:06.052871 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 538/1074] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:05 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:07.069930 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cc78899d-d1df-479f-b5a5-75b5e2a625ee tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:07.070491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-cc78899d-d1df-479f-b5a5-75b5e2a625ee tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:07.077495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc78899d-d1df-479f-b5a5-75b5e2a625ee tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:07.077942 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc78899d-d1df-479f-b5a5-75b5e2a625ee tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:07.078702 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc78899d-d1df-479f-b5a5-75b5e2a625ee tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:07.079396 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc78899d-d1df-479f-b5a5-75b5e2a625ee tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:07.202819 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cc78899d-d1df-479f-b5a5-75b5e2a625ee tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:07.210667 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-cc78899d-d1df-479f-b5a5-75b5e2a625ee tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1722 microversion: 2.1 time: 0.144727 Jun 16 15:05:07.211224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 537/1075] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:07 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:08.227691 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-dd81ae23-eb57-45cc-a125-fe1f040ef7e1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:08.228284 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-dd81ae23-eb57-45cc-a125-fe1f040ef7e1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:08.234851 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dd81ae23-eb57-45cc-a125-fe1f040ef7e1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:08.235291 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dd81ae23-eb57-45cc-a125-fe1f040ef7e1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:08.236062 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dd81ae23-eb57-45cc-a125-fe1f040ef7e1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:08.236492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-dd81ae23-eb57-45cc-a125-fe1f040ef7e1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:08.364651 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-dd81ae23-eb57-45cc-a125-fe1f040ef7e1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:08.372470 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-dd81ae23-eb57-45cc-a125-fe1f040ef7e1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1722 microversion: 2.1 time: 0.148698 Jun 16 15:05:08.373023 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 539/1076] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:08 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:09.389411 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-71a57dbe-2b36-4403-bdd2-793b0d98161b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:09.390018 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-71a57dbe-2b36-4403-bdd2-793b0d98161b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:09.397342 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-71a57dbe-2b36-4403-bdd2-793b0d98161b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:09.397789 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-71a57dbe-2b36-4403-bdd2-793b0d98161b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:09.398550 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-71a57dbe-2b36-4403-bdd2-793b0d98161b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:09.398986 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-71a57dbe-2b36-4403-bdd2-793b0d98161b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:09.528688 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-71a57dbe-2b36-4403-bdd2-793b0d98161b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:09.537119 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-71a57dbe-2b36-4403-bdd2-793b0d98161b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1699 microversion: 2.1 time: 0.151587 Jun 16 15:05:09.537679 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 538/1077] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:09 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1699 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:09.553711 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-871e8895-f375-43f1-a778-e7d3563bfc36 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:05:09.560212 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-871e8895-f375-43f1-a778-e7d3563bfc36 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:09.560654 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-871e8895-f375-43f1-a778-e7d3563bfc36 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:09.620110 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-871e8895-f375-43f1-a778-e7d3563bfc36 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Going to try to start instance {{(pid=117443) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 15:05:09.659622 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-871e8895-f375-43f1-a778-e7d3563bfc36 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "POST /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15/action" status: 202 len: 0 microversion: 2.1 time: 0.109486 Jun 16 15:05:09.660267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 540/1078] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Jun 16 15:05:09 2022] POST /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:05:09.669219 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b3d71500-2c4f-4325-a113-506e998824ce tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:09.670015 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b3d71500-2c4f-4325-a113-506e998824ce tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:09.676596 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b3d71500-2c4f-4325-a113-506e998824ce tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:09.677182 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b3d71500-2c4f-4325-a113-506e998824ce tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:09.678117 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b3d71500-2c4f-4325-a113-506e998824ce tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:09.678581 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b3d71500-2c4f-4325-a113-506e998824ce tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:09.849472 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b3d71500-2c4f-4325-a113-506e998824ce tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:09.857463 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b3d71500-2c4f-4325-a113-506e998824ce tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1708 microversion: 2.1 time: 0.192832 Jun 16 15:05:09.858030 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 539/1079] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:09 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1708 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:10.876038 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-e52a13fb-659e-4b65-bdaf-9560b810b42a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:10.876770 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-e52a13fb-659e-4b65-bdaf-9560b810b42a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:10.882932 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e52a13fb-659e-4b65-bdaf-9560b810b42a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:10.883376 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e52a13fb-659e-4b65-bdaf-9560b810b42a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:10.884164 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e52a13fb-659e-4b65-bdaf-9560b810b42a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:10.884597 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-e52a13fb-659e-4b65-bdaf-9560b810b42a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:11.019391 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-e52a13fb-659e-4b65-bdaf-9560b810b42a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:11.027325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-e52a13fb-659e-4b65-bdaf-9560b810b42a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1708 microversion: 2.1 time: 0.156133 Jun 16 15:05:11.027918 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 541/1080] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:10 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1708 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:12.044542 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6c644e61-21fd-4ebb-9c7f-8906ec82c109 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:12.045139 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6c644e61-21fd-4ebb-9c7f-8906ec82c109 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:12.051577 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6c644e61-21fd-4ebb-9c7f-8906ec82c109 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:12.052048 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6c644e61-21fd-4ebb-9c7f-8906ec82c109 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:12.052796 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6c644e61-21fd-4ebb-9c7f-8906ec82c109 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:12.053227 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6c644e61-21fd-4ebb-9c7f-8906ec82c109 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:12.179190 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6c644e61-21fd-4ebb-9c7f-8906ec82c109 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:12.187611 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6c644e61-21fd-4ebb-9c7f-8906ec82c109 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1712 microversion: 2.1 time: 0.147433 Jun 16 15:05:12.188201 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 540/1081] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:12 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1712 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:44.835473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c4a60191-664e-4c26-b004-09aa4fd45738 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:44.836091 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c4a60191-664e-4c26-b004-09aa4fd45738 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:44.838536 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:44.839180 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:44.845731 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c4a60191-664e-4c26-b004-09aa4fd45738 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:44.846176 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c4a60191-664e-4c26-b004-09aa4fd45738 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:44.846919 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c4a60191-664e-4c26-b004-09aa4fd45738 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:44.847344 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c4a60191-664e-4c26-b004-09aa4fd45738 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:45.127630 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.objects.instance [None req-c4a60191-664e-4c26-b004-09aa4fd45738 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lazy-loading 'services' on Instance uuid 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 {{(pid=117443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:05:45.203061 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c4a60191-664e-4c26-b004-09aa4fd45738 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "DELETE /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15/os-volume_attachments/813bfa58-d63a-44e3-aa1b-10f1a96b00ef" status: 202 len: 0 microversion: 2.1 time: 0.371176 Jun 16 15:05:45.203607 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 542/1082] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Jun 16 15:05:44 2022] DELETE /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15/os-volume_attachments/813bfa58-d63a-44e3-aa1b-10f1a96b00ef => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:05:46.318470 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f5b35d77-6495-4794-ab4a-e0e976c99e53 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:05:46.320798 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=16 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:46.321443 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:46.328686 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f5b35d77-6495-4794-ab4a-e0e976c99e53 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:46.329133 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f5b35d77-6495-4794-ab4a-e0e976c99e53 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:46.352529 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f5b35d77-6495-4794-ab4a-e0e976c99e53 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Going to try to stop instance {{(pid=117444) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 15:05:46.392950 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f5b35d77-6495-4794-ab4a-e0e976c99e53 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "POST /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15/action" status: 202 len: 0 microversion: 2.1 time: 0.078102 Jun 16 15:05:46.393537 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 541/1083] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Jun 16 15:05:46 2022] POST /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:05:46.405063 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f0c9de16-8285-4ceb-905f-12cb659fab7c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:46.405766 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f0c9de16-8285-4ceb-905f-12cb659fab7c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:46.413131 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f0c9de16-8285-4ceb-905f-12cb659fab7c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:46.413665 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f0c9de16-8285-4ceb-905f-12cb659fab7c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:46.414436 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f0c9de16-8285-4ceb-905f-12cb659fab7c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:46.415818 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f0c9de16-8285-4ceb-905f-12cb659fab7c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:46.547910 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f0c9de16-8285-4ceb-905f-12cb659fab7c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:46.555371 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f0c9de16-8285-4ceb-905f-12cb659fab7c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1676 microversion: 2.1 time: 0.156486 Jun 16 15:05:46.555972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 543/1084] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:46 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:47.573785 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-bca28114-f77a-4573-b954-489a2d05ea4d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:47.574484 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-bca28114-f77a-4573-b954-489a2d05ea4d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:47.580741 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bca28114-f77a-4573-b954-489a2d05ea4d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:47.581193 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bca28114-f77a-4573-b954-489a2d05ea4d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:47.581956 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bca28114-f77a-4573-b954-489a2d05ea4d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:47.582399 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bca28114-f77a-4573-b954-489a2d05ea4d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:47.811590 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-bca28114-f77a-4573-b954-489a2d05ea4d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:47.819210 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-bca28114-f77a-4573-b954-489a2d05ea4d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1676 microversion: 2.1 time: 0.250307 Jun 16 15:05:47.819799 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 542/1085] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:47 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1676 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:48.837612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-316c0e73-1ed7-4412-b16c-c4487d6c158d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:48.838220 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-316c0e73-1ed7-4412-b16c-c4487d6c158d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:48.844424 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-316c0e73-1ed7-4412-b16c-c4487d6c158d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:48.844877 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-316c0e73-1ed7-4412-b16c-c4487d6c158d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:48.845633 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-316c0e73-1ed7-4412-b16c-c4487d6c158d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:48.846068 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-316c0e73-1ed7-4412-b16c-c4487d6c158d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:49.036584 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-316c0e73-1ed7-4412-b16c-c4487d6c158d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:49.044579 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-316c0e73-1ed7-4412-b16c-c4487d6c158d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1676 microversion: 2.1 time: 0.210826 Jun 16 15:05:49.045153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 544/1086] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:48 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1676 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:50.062207 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-02643a87-5a80-408e-b352-e5719ecae49a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:50.062816 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-02643a87-5a80-408e-b352-e5719ecae49a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:50.069146 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-02643a87-5a80-408e-b352-e5719ecae49a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:50.069629 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-02643a87-5a80-408e-b352-e5719ecae49a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:50.070398 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-02643a87-5a80-408e-b352-e5719ecae49a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:50.070841 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-02643a87-5a80-408e-b352-e5719ecae49a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:50.198003 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-02643a87-5a80-408e-b352-e5719ecae49a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:50.205500 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-02643a87-5a80-408e-b352-e5719ecae49a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1676 microversion: 2.1 time: 0.147254 Jun 16 15:05:50.206053 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 543/1087] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:50 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:51.222273 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b8908d0c-4bf5-4353-bbed-854839d6e469 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:51.222874 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b8908d0c-4bf5-4353-bbed-854839d6e469 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:51.229814 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b8908d0c-4bf5-4353-bbed-854839d6e469 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:51.230266 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b8908d0c-4bf5-4353-bbed-854839d6e469 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:51.231016 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b8908d0c-4bf5-4353-bbed-854839d6e469 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:51.231444 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b8908d0c-4bf5-4353-bbed-854839d6e469 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:51.358643 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b8908d0c-4bf5-4353-bbed-854839d6e469 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:51.366143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b8908d0c-4bf5-4353-bbed-854839d6e469 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1676 microversion: 2.1 time: 0.147741 Jun 16 15:05:51.366692 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 545/1088] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:51 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:52.341490 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:05:52.342085 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Thu Jun 16 15:05:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:05:52.383082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2529980c-44b1-45aa-b01a-9066bcb0647a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:52.383710 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2529980c-44b1-45aa-b01a-9066bcb0647a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:52.390550 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2529980c-44b1-45aa-b01a-9066bcb0647a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:52.391005 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2529980c-44b1-45aa-b01a-9066bcb0647a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:52.391812 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2529980c-44b1-45aa-b01a-9066bcb0647a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:52.392256 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2529980c-44b1-45aa-b01a-9066bcb0647a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:52.523743 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2529980c-44b1-45aa-b01a-9066bcb0647a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:52.531961 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2529980c-44b1-45aa-b01a-9066bcb0647a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1676 microversion: 2.1 time: 0.152613 Jun 16 15:05:52.532528 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 544/1089] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:52 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:52.843741 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:05:52.844274 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Thu Jun 16 15:05:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:05:53.549360 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ed1875a0-f04a-4b98-bf52-e8e8bdecbc3e tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:53.549966 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ed1875a0-f04a-4b98-bf52-e8e8bdecbc3e tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:53.557081 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ed1875a0-f04a-4b98-bf52-e8e8bdecbc3e tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:53.557528 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ed1875a0-f04a-4b98-bf52-e8e8bdecbc3e tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:53.558287 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ed1875a0-f04a-4b98-bf52-e8e8bdecbc3e tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:53.558719 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ed1875a0-f04a-4b98-bf52-e8e8bdecbc3e tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:53.684648 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ed1875a0-f04a-4b98-bf52-e8e8bdecbc3e tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:53.692177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ed1875a0-f04a-4b98-bf52-e8e8bdecbc3e tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1676 microversion: 2.1 time: 0.146971 Jun 16 15:05:53.692729 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 546/1090] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:53 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:54.709303 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1c819dea-c8c6-463d-b5b6-8e9e6d36494c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:54.709918 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1c819dea-c8c6-463d-b5b6-8e9e6d36494c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:54.717124 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1c819dea-c8c6-463d-b5b6-8e9e6d36494c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:54.717576 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1c819dea-c8c6-463d-b5b6-8e9e6d36494c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:54.718343 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1c819dea-c8c6-463d-b5b6-8e9e6d36494c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:54.718788 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1c819dea-c8c6-463d-b5b6-8e9e6d36494c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:55.101742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1c819dea-c8c6-463d-b5b6-8e9e6d36494c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:55.109629 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1c819dea-c8c6-463d-b5b6-8e9e6d36494c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1676 microversion: 2.1 time: 0.404214 Jun 16 15:05:55.110181 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 545/1091] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:54 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1676 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:56.127294 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1aa70df7-b777-4f49-840f-63f384ecce42 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:56.127977 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-1aa70df7-b777-4f49-840f-63f384ecce42 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:56.134527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1aa70df7-b777-4f49-840f-63f384ecce42 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:56.134968 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1aa70df7-b777-4f49-840f-63f384ecce42 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:56.135766 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1aa70df7-b777-4f49-840f-63f384ecce42 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:56.136215 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1aa70df7-b777-4f49-840f-63f384ecce42 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:56.261146 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1aa70df7-b777-4f49-840f-63f384ecce42 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:56.268620 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1aa70df7-b777-4f49-840f-63f384ecce42 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1676 microversion: 2.1 time: 0.145397 Jun 16 15:05:56.269182 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 547/1092] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:56 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:57.285912 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4f042bc2-8b07-4987-b93c-28d0e4c02a0b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:57.286514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4f042bc2-8b07-4987-b93c-28d0e4c02a0b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:57.293081 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4f042bc2-8b07-4987-b93c-28d0e4c02a0b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:57.293534 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4f042bc2-8b07-4987-b93c-28d0e4c02a0b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:57.294329 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4f042bc2-8b07-4987-b93c-28d0e4c02a0b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:57.294764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4f042bc2-8b07-4987-b93c-28d0e4c02a0b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:57.428551 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4f042bc2-8b07-4987-b93c-28d0e4c02a0b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:57.436551 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4f042bc2-8b07-4987-b93c-28d0e4c02a0b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1653 microversion: 2.1 time: 0.154844 Jun 16 15:05:57.437209 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 546/1093] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:57 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1653 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:57.453277 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c5afb3f9-fd03-4b4b-9ad0-0474ddf70a62 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:05:57.459660 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c5afb3f9-fd03-4b4b-9ad0-0474ddf70a62 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:57.460125 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c5afb3f9-fd03-4b4b-9ad0-0474ddf70a62 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:57.482981 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c5afb3f9-fd03-4b4b-9ad0-0474ddf70a62 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Going to try to start instance {{(pid=117443) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 15:05:57.524267 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c5afb3f9-fd03-4b4b-9ad0-0474ddf70a62 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "POST /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15/action" status: 202 len: 0 microversion: 2.1 time: 0.074676 Jun 16 15:05:57.524888 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 548/1094] 10.222.0.76 () {60 vars in 1277 bytes} [Thu Jun 16 15:05:57 2022] POST /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:05:57.534402 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4491fd80-0483-4311-871f-4809956a1580 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:57.535019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4491fd80-0483-4311-871f-4809956a1580 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:57.541910 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4491fd80-0483-4311-871f-4809956a1580 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:57.542264 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4491fd80-0483-4311-871f-4809956a1580 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:57.543032 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4491fd80-0483-4311-871f-4809956a1580 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:57.543463 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4491fd80-0483-4311-871f-4809956a1580 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:57.728977 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4491fd80-0483-4311-871f-4809956a1580 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:57.736810 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4491fd80-0483-4311-871f-4809956a1580 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1662 microversion: 2.1 time: 0.206742 Jun 16 15:05:57.737388 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 547/1095] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:57 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1662 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:58.755229 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ab02b41d-9b76-4119-877b-962377d0ddc0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:58.755946 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ab02b41d-9b76-4119-877b-962377d0ddc0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:58.762834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ab02b41d-9b76-4119-877b-962377d0ddc0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:58.763278 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ab02b41d-9b76-4119-877b-962377d0ddc0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:58.764061 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ab02b41d-9b76-4119-877b-962377d0ddc0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:58.764493 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-ab02b41d-9b76-4119-877b-962377d0ddc0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:58.892785 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ab02b41d-9b76-4119-877b-962377d0ddc0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:58.900334 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ab02b41d-9b76-4119-877b-962377d0ddc0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1666 microversion: 2.1 time: 0.149724 Jun 16 15:05:58.900892 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 549/1096] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:58 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:31.080729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d872347c-e4a1-43c6-9782-4c17edf64883 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:31.081657 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d872347c-e4a1-43c6-9782-4c17edf64883 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:31.083930 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=14 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:31.084708 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:31.091293 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d872347c-e4a1-43c6-9782-4c17edf64883 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:31.091769 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d872347c-e4a1-43c6-9782-4c17edf64883 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:31.092572 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d872347c-e4a1-43c6-9782-4c17edf64883 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:31.093007 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d872347c-e4a1-43c6-9782-4c17edf64883 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:31.122988 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d872347c-e4a1-43c6-9782-4c17edf64883 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046197 Jun 16 15:06:31.123534 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 548/1097] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:06:31 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 15:06:31.180767 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6cb188ee-c6fe-428f-9f5b-fd70f4709ada tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:31.181275 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6cb188ee-c6fe-428f-9f5b-fd70f4709ada tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:31.183480 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=16 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:31.184282 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:31.189612 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6cb188ee-c6fe-428f-9f5b-fd70f4709ada tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:31.190060 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6cb188ee-c6fe-428f-9f5b-fd70f4709ada tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:31.190812 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6cb188ee-c6fe-428f-9f5b-fd70f4709ada tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:31.191243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6cb188ee-c6fe-428f-9f5b-fd70f4709ada tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:31.216753 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6cb188ee-c6fe-428f-9f5b-fd70f4709ada tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Going to try to terminate instance {{(pid=117443) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:06:31.291221 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6cb188ee-c6fe-428f-9f5b-fd70f4709ada tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "DELETE /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 204 len: 0 microversion: 2.1 time: 0.113234 Jun 16 15:06:31.291788 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 550/1098] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:06:31 2022] DELETE /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:06:31.300299 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b055c4d8-1c46-496c-b82f-45be49a62b9f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:31.300907 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b055c4d8-1c46-496c-b82f-45be49a62b9f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:31.306778 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b055c4d8-1c46-496c-b82f-45be49a62b9f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:31.307227 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b055c4d8-1c46-496c-b82f-45be49a62b9f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:31.308164 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b055c4d8-1c46-496c-b82f-45be49a62b9f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:31.308604 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b055c4d8-1c46-496c-b82f-45be49a62b9f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:31.449269 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b055c4d8-1c46-496c-b82f-45be49a62b9f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:31.456757 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b055c4d8-1c46-496c-b82f-45be49a62b9f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1672 microversion: 2.1 time: 0.160292 Jun 16 15:06:31.457312 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 549/1099] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:31 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:32.475076 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1dac2d10-97a7-48c5-a2d8-aad072c9a665 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:32.475801 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-1dac2d10-97a7-48c5-a2d8-aad072c9a665 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:32.482202 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1dac2d10-97a7-48c5-a2d8-aad072c9a665 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:32.482645 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1dac2d10-97a7-48c5-a2d8-aad072c9a665 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:32.483398 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1dac2d10-97a7-48c5-a2d8-aad072c9a665 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:32.483895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1dac2d10-97a7-48c5-a2d8-aad072c9a665 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:32.610922 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1dac2d10-97a7-48c5-a2d8-aad072c9a665 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:32.618917 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1dac2d10-97a7-48c5-a2d8-aad072c9a665 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1672 microversion: 2.1 time: 0.147576 Jun 16 15:06:32.619477 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 551/1100] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:32 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:33.636162 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-bf629e89-d412-4597-a6cb-92bb57b9edaa tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:33.636762 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-bf629e89-d412-4597-a6cb-92bb57b9edaa tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:33.643071 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bf629e89-d412-4597-a6cb-92bb57b9edaa tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:33.643520 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bf629e89-d412-4597-a6cb-92bb57b9edaa tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:33.644324 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bf629e89-d412-4597-a6cb-92bb57b9edaa tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:33.644760 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bf629e89-d412-4597-a6cb-92bb57b9edaa tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:33.836480 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-bf629e89-d412-4597-a6cb-92bb57b9edaa tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:33.844129 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-bf629e89-d412-4597-a6cb-92bb57b9edaa tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 200 len: 1672 microversion: 2.1 time: 0.211865 Jun 16 15:06:33.844692 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 550/1101] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:33 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 1672 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:34.231667 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-13b24ea6-6f57-4590-bb5f-c459aa155220 req-7f7af31b-cddb-4b53-a7ff-26b21f47ea40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80fc06fb-d5ab-4b9e-bdc2-bb043f52da15", "name": "network-vif-deleted", "tag": "0cb8ad0c-d793-4e45-8b3b-d1eca6b77276"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:06:34.242399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-13b24ea6-6f57-4590-bb5f-c459aa155220 req-7f7af31b-cddb-4b53-a7ff-26b21f47ea40 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:34.242842 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-13b24ea6-6f57-4590-bb5f-c459aa155220 req-7f7af31b-cddb-4b53-a7ff-26b21f47ea40 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:34.255527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-13b24ea6-6f57-4590-bb5f-c459aa155220 req-7f7af31b-cddb-4b53-a7ff-26b21f47ea40 service nova] Creating event network-vif-deleted:0cb8ad0c-d793-4e45-8b3b-d1eca6b77276 for instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 on hv-cinder-83716 Jun 16 15:06:34.260902 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-13b24ea6-6f57-4590-bb5f-c459aa155220 req-7f7af31b-cddb-4b53-a7ff-26b21f47ea40 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098862 Jun 16 15:06:34.261874 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 552/1102] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:06:34.862262 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-131b91d1-bb20-477d-8479-b8d144b30bf7 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:34.863384 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-131b91d1-bb20-477d-8479-b8d144b30bf7 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:34.871054 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-131b91d1-bb20-477d-8479-b8d144b30bf7 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:34.871642 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-131b91d1-bb20-477d-8479-b8d144b30bf7 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:34.872449 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-131b91d1-bb20-477d-8479-b8d144b30bf7 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:34.872901 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-131b91d1-bb20-477d-8479-b8d144b30bf7 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:34.888097 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-131b91d1-bb20-477d-8479-b8d144b30bf7 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] HTTP exception thrown: Instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 could not be found. Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-131b91d1-bb20-477d-8479-b8d144b30bf7 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Request method failure captured: Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 HTTP/1.1 Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0Zad52qz65TyY076obNvggHLh-Aog-PNWUKB2qe4CzRETfVo6c0wf1F1XXs2ZxwQaFFNKB9xMpg2stvWOO_MzX7X8PkYDbNreKCTlGMruHf9XxbZpf7yTYB8Z11x00fOqU9LAwq5p_axLIIdKw0PsUlQwTTL4MdMIZ6yRswPq3Tf9s Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 1e2ff2a55903449bb4c5364e64645931 Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeTestJSON-1738513634 Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:06:34.890019 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:06:34.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:06:34.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeTestJSON-1738513634 Jun 16 15:06:34.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 1e2ff2a55903449bb4c5364e64645931 Jun 16 15:06:34.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1738513634 Jun 16 15:06:34.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeTestJSON-1738513634-project Jun 16 15:06:34.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:06:34.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:06:34.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: b8bd17e43c3a4c22bedf4d8011a6f064 Jun 16 15:06:34.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeTestJSON-1738513634-project Jun 16 15:06:34.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:06:34.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 could not be found. Jun 16 15:06:34.891715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': '80fc06fb-d5ab-4b9e-bdc2-bb043f52da15'} Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 could not be found. Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:06:34.893069 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:06:34.894614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:06:34.894614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:06:34.894614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:06:34.894614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:06:34.894614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:06:34.894614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:06:34.894614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:06:34.894614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 could not be found. Jun 16 15:06:34.894614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:06:34.894614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:06:34.894614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:06:34.894614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:06:34.894614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:06:34.894614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:06:34.894614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:06:34.894614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:06:34.894614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 could not be found. Jun 16 15:06:34.894614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:06:34.896189 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-131b91d1-bb20-477d-8479-b8d144b30bf7 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Returning 404 to user: Instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:06:34.896189 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-131b91d1-bb20-477d-8479-b8d144b30bf7 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 404 len: 111 microversion: 2.1 time: 0.033091 Jun 16 15:06:34.896189 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 551/1103] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:34 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:06:34.900637 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3b15f7be-9efd-4575-91e6-864e8e21d307 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '.version_select at 0x7f33e12cca60>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:34.922318 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3b15f7be-9efd-4575-91e6-864e8e21d307 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-367935529" status: 202 len: 0 microversion: 2.1 time: 0.025428 Jun 16 15:06:34.922635 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 553/1104] 10.222.0.76 () {58 vars in 1217 bytes} [Thu Jun 16 15:06:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-367935529 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 15:06:35.553574 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c2159815-19e9-4df4-ba78-029ab215110b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Action: 'create', calling method: .version_select at 0x7f33e1668040>, body: {"keypair": {"name": "tempest-keypair-2016135264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8SNqOuAsFFpDc67aw9tx1b7mAWe62PfPLohJ9TZuZqvlnW4/B6fRwkDsBvGqRd/qgBSadvz8H2SxIOjpjoqcejQfh/Oaqh+03eIZNXmOoRWPueRoQiGlBJT7h9R6Dg9A=="}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:06:35.567812 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-c2159815-19e9-4df4-ba78-029ab215110b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Getting quotas for project 1e2ff2a55903449bb4c5364e64645931. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:06:35.572560 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-c2159815-19e9-4df4-ba78-029ab215110b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Getting quotas for user b8bd17e43c3a4c22bedf4d8011a6f064 and project 1e2ff2a55903449bb4c5364e64645931. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:06:35.594944 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c2159815-19e9-4df4-ba78-029ab215110b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045322 Jun 16 15:06:35.595522 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 552/1105] 10.222.0.76 () {60 vars in 1158 bytes} [Thu Jun 16 15:06:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:06:36.838586 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-20138619-1989-49d1-b37b-dc322b01a659 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1629984195", "imageRef": "f2f37ffa-db20-478d-84c0-b429a987933c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef31a3e7-e507-4708-8c9e-527bbd733b76"}], "security_groups": [{"name": "tempest-securitygroup--2128482469"}], "key_name": "tempest-keypair-2016135264", "user_data": "}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:06:36.942104 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.network.neutron [None req-20138619-1989-49d1-b37b-dc322b01a659 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] validate_networks() for [('ef31a3e7-e507-4708-8c9e-527bbd733b76', None, None, None, None, None)] {{(pid=117443) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:06:37.358122 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-20138619-1989-49d1-b37b-dc322b01a659 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Flavor limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:06:37.358553 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-20138619-1989-49d1-b37b-dc322b01a659 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Image limits 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:06:37.359030 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-20138619-1989-49d1-b37b-dc322b01a659 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Flavor pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:06:37.359442 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-20138619-1989-49d1-b37b-dc322b01a659 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Image pref 0:0:0 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:06:37.359890 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.virt.hardware [None req-20138619-1989-49d1-b37b-dc322b01a659 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:06:37.372434 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-20138619-1989-49d1-b37b-dc322b01a659 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:37.372882 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-20138619-1989-49d1-b37b-dc322b01a659 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:37.373683 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-20138619-1989-49d1-b37b-dc322b01a659 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:37.374139 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-20138619-1989-49d1-b37b-dc322b01a659 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:37.391047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-20138619-1989-49d1-b37b-dc322b01a659 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Getting quotas for project 1e2ff2a55903449bb4c5364e64645931. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:06:37.394897 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-20138619-1989-49d1-b37b-dc322b01a659 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Getting quotas for user b8bd17e43c3a4c22bedf4d8011a6f064 and project 1e2ff2a55903449bb4c5364e64645931. Resources: {'ram', 'cores', 'instances'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:06:37.406768 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-20138619-1989-49d1-b37b-dc322b01a659 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Going to run 1 instances... {{(pid=117443) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:06:37.409228 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-20138619-1989-49d1-b37b-dc322b01a659 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2f37ffa-db20-478d-84c0-b429a987933c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:06:37.456903 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-20138619-1989-49d1-b37b-dc322b01a659 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.623085 Jun 16 15:06:37.457540 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 554/1106] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 15:06:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 15:06:37.468122 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-171af4a0-6d41-4b7e-9052-8b2fc1055f25 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:37.468827 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-171af4a0-6d41-4b7e-9052-8b2fc1055f25 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:37.522332 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-171af4a0-6d41-4b7e-9052-8b2fc1055f25 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:37.529170 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-171af4a0-6d41-4b7e-9052-8b2fc1055f25 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5" status: 200 len: 1238 microversion: 2.1 time: 0.065432 Jun 16 15:06:37.530052 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 553/1107] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:37 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:38.546183 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-f6b10a30-5208-42f9-90f7-9cac72909cb8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:38.546783 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-f6b10a30-5208-42f9-90f7-9cac72909cb8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:38.557118 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f6b10a30-5208-42f9-90f7-9cac72909cb8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:38.557578 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f6b10a30-5208-42f9-90f7-9cac72909cb8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:38.558363 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f6b10a30-5208-42f9-90f7-9cac72909cb8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:38.558802 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-f6b10a30-5208-42f9-90f7-9cac72909cb8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:38.657807 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-f6b10a30-5208-42f9-90f7-9cac72909cb8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:38.673206 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-f6b10a30-5208-42f9-90f7-9cac72909cb8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5" status: 200 len: 1298 microversion: 2.1 time: 0.131097 Jun 16 15:06:38.674407 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 555/1108] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:38 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 => generated 1298 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:06:39.693553 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ddc9f71a-6e9b-4011-946d-8f088d1abcb5 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:39.694172 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ddc9f71a-6e9b-4011-946d-8f088d1abcb5 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:39.700734 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ddc9f71a-6e9b-4011-946d-8f088d1abcb5 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:39.701187 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ddc9f71a-6e9b-4011-946d-8f088d1abcb5 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:39.701954 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ddc9f71a-6e9b-4011-946d-8f088d1abcb5 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:39.702393 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ddc9f71a-6e9b-4011-946d-8f088d1abcb5 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:39.895368 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ddc9f71a-6e9b-4011-946d-8f088d1abcb5 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:39.903672 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ddc9f71a-6e9b-4011-946d-8f088d1abcb5 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5" status: 200 len: 1364 microversion: 2.1 time: 0.214181 Jun 16 15:06:39.904487 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 554/1109] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:39 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:40.178272 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-2fd60f48-3cd7-4993-960d-b943fca909eb req-d57b1c76-3430-454d-9e40-e207d070764f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "811e0c92-bd5b-4188-b909-86451f68b9c5", "tag": "672f1667-8ade-4398-a319-4be060e56dd9"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:06:40.187896 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-2fd60f48-3cd7-4993-960d-b943fca909eb req-d57b1c76-3430-454d-9e40-e207d070764f service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:40.188597 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-2fd60f48-3cd7-4993-960d-b943fca909eb req-d57b1c76-3430-454d-9e40-e207d070764f service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:40.215065 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-2fd60f48-3cd7-4993-960d-b943fca909eb req-d57b1c76-3430-454d-9e40-e207d070764f service nova] Creating event network-changed:672f1667-8ade-4398-a319-4be060e56dd9 for instance 811e0c92-bd5b-4188-b909-86451f68b9c5 on hv-cinder-83716 Jun 16 15:06:40.220154 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-2fd60f48-3cd7-4993-960d-b943fca909eb req-d57b1c76-3430-454d-9e40-e207d070764f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045945 Jun 16 15:06:40.220760 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 556/1110] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:06:40.920177 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-10653f83-72f3-4afb-b6fb-a83670523a8b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:40.920732 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-10653f83-72f3-4afb-b6fb-a83670523a8b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:40.927252 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10653f83-72f3-4afb-b6fb-a83670523a8b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:40.927723 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10653f83-72f3-4afb-b6fb-a83670523a8b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:40.928485 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10653f83-72f3-4afb-b6fb-a83670523a8b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:40.928920 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10653f83-72f3-4afb-b6fb-a83670523a8b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:41.058374 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-10653f83-72f3-4afb-b6fb-a83670523a8b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:41.065953 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-10653f83-72f3-4afb-b6fb-a83670523a8b tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5" status: 200 len: 1364 microversion: 2.1 time: 0.149919 Jun 16 15:06:41.066519 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 555/1111] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:40 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:42.083216 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-577a689c-02ab-45c8-806a-d3fe33f4a809 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:42.083922 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-577a689c-02ab-45c8-806a-d3fe33f4a809 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:42.090610 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-577a689c-02ab-45c8-806a-d3fe33f4a809 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:42.091049 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-577a689c-02ab-45c8-806a-d3fe33f4a809 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:42.091825 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-577a689c-02ab-45c8-806a-d3fe33f4a809 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:42.092258 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-577a689c-02ab-45c8-806a-d3fe33f4a809 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:42.221966 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-577a689c-02ab-45c8-806a-d3fe33f4a809 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:42.230808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-577a689c-02ab-45c8-806a-d3fe33f4a809 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5" status: 200 len: 1364 microversion: 2.1 time: 0.152266 Jun 16 15:06:42.231365 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 557/1112] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:42 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:43.246739 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ec7c2134-5905-40a2-9799-9eed9095b7a1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:43.247362 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ec7c2134-5905-40a2-9799-9eed9095b7a1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:43.253980 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ec7c2134-5905-40a2-9799-9eed9095b7a1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:43.254459 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ec7c2134-5905-40a2-9799-9eed9095b7a1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:43.255226 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ec7c2134-5905-40a2-9799-9eed9095b7a1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:43.255664 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ec7c2134-5905-40a2-9799-9eed9095b7a1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:43.380143 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ec7c2134-5905-40a2-9799-9eed9095b7a1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:43.387965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ec7c2134-5905-40a2-9799-9eed9095b7a1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5" status: 200 len: 1364 microversion: 2.1 time: 0.145332 Jun 16 15:06:43.388514 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 556/1113] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:43 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:44.405486 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b950e503-cfa9-4b12-93b4-a6dc1825592f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:44.406094 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b950e503-cfa9-4b12-93b4-a6dc1825592f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:44.412835 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b950e503-cfa9-4b12-93b4-a6dc1825592f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:44.413283 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b950e503-cfa9-4b12-93b4-a6dc1825592f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:44.414041 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b950e503-cfa9-4b12-93b4-a6dc1825592f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:44.414479 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b950e503-cfa9-4b12-93b4-a6dc1825592f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:44.542509 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b950e503-cfa9-4b12-93b4-a6dc1825592f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:44.550153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b950e503-cfa9-4b12-93b4-a6dc1825592f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5" status: 200 len: 1364 microversion: 2.1 time: 0.148495 Jun 16 15:06:44.550716 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 558/1114] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:44 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:45.566967 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f2fa4762-04b7-4a90-bf83-623e38155111 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:45.567571 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f2fa4762-04b7-4a90-bf83-623e38155111 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:45.575291 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f2fa4762-04b7-4a90-bf83-623e38155111 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:45.575809 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f2fa4762-04b7-4a90-bf83-623e38155111 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:45.577269 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f2fa4762-04b7-4a90-bf83-623e38155111 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:45.577726 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f2fa4762-04b7-4a90-bf83-623e38155111 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:45.708538 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f2fa4762-04b7-4a90-bf83-623e38155111 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:45.716416 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f2fa4762-04b7-4a90-bf83-623e38155111 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5" status: 200 len: 1364 microversion: 2.1 time: 0.153326 Jun 16 15:06:45.716968 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 557/1115] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:45 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:46.235095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-0986dcda-3dcd-4b71-b33b-5b62f0dbb46c req-bb42a446-7675-4e32-ba96-7e31a612cf25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811e0c92-bd5b-4188-b909-86451f68b9c5", "name": "network-vif-plugged", "status": "completed", "tag": "672f1667-8ade-4398-a319-4be060e56dd9"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:06:46.243833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-0986dcda-3dcd-4b71-b33b-5b62f0dbb46c req-bb42a446-7675-4e32-ba96-7e31a612cf25 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:46.244341 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-0986dcda-3dcd-4b71-b33b-5b62f0dbb46c req-bb42a446-7675-4e32-ba96-7e31a612cf25 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:46.262118 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-0986dcda-3dcd-4b71-b33b-5b62f0dbb46c req-bb42a446-7675-4e32-ba96-7e31a612cf25 service nova] Creating event network-vif-plugged:672f1667-8ade-4398-a319-4be060e56dd9 for instance 811e0c92-bd5b-4188-b909-86451f68b9c5 on hv-cinder-83716 Jun 16 15:06:46.267349 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-0986dcda-3dcd-4b71-b33b-5b62f0dbb46c req-bb42a446-7675-4e32-ba96-7e31a612cf25 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035916 Jun 16 15:06:46.267982 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 559/1116] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:06:46.733314 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-404018ad-d13f-4c67-a7c0-adda162704b3 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:46.733867 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-404018ad-d13f-4c67-a7c0-adda162704b3 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:46.740385 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-404018ad-d13f-4c67-a7c0-adda162704b3 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:46.740839 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-404018ad-d13f-4c67-a7c0-adda162704b3 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:46.741604 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-404018ad-d13f-4c67-a7c0-adda162704b3 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:46.742040 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-404018ad-d13f-4c67-a7c0-adda162704b3 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:46.875698 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-404018ad-d13f-4c67-a7c0-adda162704b3 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:46.883241 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-404018ad-d13f-4c67-a7c0-adda162704b3 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5" status: 200 len: 1364 microversion: 2.1 time: 0.153864 Jun 16 15:06:46.884399 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 558/1117] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:46 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:47.898468 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=2 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:47.899218 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=6 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:47.903453 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-61412b3d-16e6-476c-99d5-71f658dc5da8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:47.904168 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-61412b3d-16e6-476c-99d5-71f658dc5da8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:47.911583 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-61412b3d-16e6-476c-99d5-71f658dc5da8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:47.912063 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-61412b3d-16e6-476c-99d5-71f658dc5da8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:47.912917 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-61412b3d-16e6-476c-99d5-71f658dc5da8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:47.913252 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-61412b3d-16e6-476c-99d5-71f658dc5da8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:48.042426 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-61412b3d-16e6-476c-99d5-71f658dc5da8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:48.049839 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-61412b3d-16e6-476c-99d5-71f658dc5da8 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5" status: 200 len: 1549 microversion: 2.1 time: 0.152862 Jun 16 15:06:48.050398 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 560/1118] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:47 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:48.066370 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-189435a0-c67d-4bd7-8a98-4f5e9e9bda24 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:48.066870 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-189435a0-c67d-4bd7-8a98-4f5e9e9bda24 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:48.068764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=6 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:48.074941 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-189435a0-c67d-4bd7-8a98-4f5e9e9bda24 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:48.075390 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-189435a0-c67d-4bd7-8a98-4f5e9e9bda24 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:48.076166 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-189435a0-c67d-4bd7-8a98-4f5e9e9bda24 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:48.076595 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-189435a0-c67d-4bd7-8a98-4f5e9e9bda24 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:48.153026 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-189435a0-c67d-4bd7-8a98-4f5e9e9bda24 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090476 Jun 16 15:06:48.153611 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 559/1119] 10.222.0.76 () {58 vars in 1274 bytes} [Thu Jun 16 15:06:48 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:06:49.334492 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-d755311c-9993-4285-b960-26254b51fb23 req-2f59aabb-095e-4f86-b1b4-0c7ce8267fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "811e0c92-bd5b-4188-b909-86451f68b9c5", "tag": "672f1667-8ade-4398-a319-4be060e56dd9"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:06:49.343357 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-d755311c-9993-4285-b960-26254b51fb23 req-2f59aabb-095e-4f86-b1b4-0c7ce8267fc3 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:49.343941 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-d755311c-9993-4285-b960-26254b51fb23 req-2f59aabb-095e-4f86-b1b4-0c7ce8267fc3 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:49.356671 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-d755311c-9993-4285-b960-26254b51fb23 req-2f59aabb-095e-4f86-b1b4-0c7ce8267fc3 service nova] Creating event network-changed:672f1667-8ade-4398-a319-4be060e56dd9 for instance 811e0c92-bd5b-4188-b909-86451f68b9c5 on hv-cinder-83716 Jun 16 15:06:49.361964 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-d755311c-9993-4285-b960-26254b51fb23 req-2f59aabb-095e-4f86-b1b4-0c7ce8267fc3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031274 Jun 16 15:06:49.362646 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 561/1120] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:25.208461 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:25.209269 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=54 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:25.213896 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1c15d415-3fd7-4cd6-bdf9-9d514ba79b12 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:25.214385 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1c15d415-3fd7-4cd6-bdf9-9d514ba79b12 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:25.221313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1c15d415-3fd7-4cd6-bdf9-9d514ba79b12 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:25.221759 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1c15d415-3fd7-4cd6-bdf9-9d514ba79b12 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:25.222507 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1c15d415-3fd7-4cd6-bdf9-9d514ba79b12 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:25.222938 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1c15d415-3fd7-4cd6-bdf9-9d514ba79b12 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:25.246282 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1c15d415-3fd7-4cd6-bdf9-9d514ba79b12 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/ips" status: 200 len: 144 microversion: 2.1 time: 0.039357 Jun 16 15:07:25.246825 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 560/1121] 10.222.0.76 () {58 vars in 1247 bytes} [Thu Jun 16 15:07:25 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/ips => generated 144 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:26.557725 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:26.558459 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:26.563037 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c91c4039-3aef-47a3-959c-7daba1d04b3a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ce65a9f-8b26-421c-b9d2-9a7c692d8104"}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:26.564205 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c91c4039-3aef-47a3-959c-7daba1d04b3a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:26.572606 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c91c4039-3aef-47a3-959c-7daba1d04b3a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:26.573104 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c91c4039-3aef-47a3-959c-7daba1d04b3a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:26.573861 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c91c4039-3aef-47a3-959c-7daba1d04b3a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:26.574290 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c91c4039-3aef-47a3-959c-7daba1d04b3a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:26.826486 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c91c4039-3aef-47a3-959c-7daba1d04b3a tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "POST /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270213 Jun 16 15:07:26.827082 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 562/1122] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Jun 16 15:07:26 2022] POST /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:34.307055 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d46a288d-6237-4093-8732-8f693996ba17 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:34.308051 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d46a288d-6237-4093-8732-8f693996ba17 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:34.314400 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d46a288d-6237-4093-8732-8f693996ba17 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:34.314845 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d46a288d-6237-4093-8732-8f693996ba17 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:34.315590 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d46a288d-6237-4093-8732-8f693996ba17 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:34.316058 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d46a288d-6237-4093-8732-8f693996ba17 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:34.345823 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d46a288d-6237-4093-8732-8f693996ba17 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042680 Jun 16 15:07:34.346368 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 561/1123] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:07:34 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:34.357258 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7de2196c-790e-40a5-bb6c-9f47dfdf1645 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:34.357833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7de2196c-790e-40a5-bb6c-9f47dfdf1645 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:34.363970 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7de2196c-790e-40a5-bb6c-9f47dfdf1645 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:34.364421 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7de2196c-790e-40a5-bb6c-9f47dfdf1645 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:34.365176 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7de2196c-790e-40a5-bb6c-9f47dfdf1645 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:34.365609 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7de2196c-790e-40a5-bb6c-9f47dfdf1645 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:34.393647 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7de2196c-790e-40a5-bb6c-9f47dfdf1645 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments/8ce65a9f-8b26-421c-b9d2-9a7c692d8104" status: 200 len: 194 microversion: 2.1 time: 0.041183 Jun 16 15:07:34.394207 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 563/1124] 10.222.0.76 () {58 vars in 1412 bytes} [Thu Jun 16 15:07:34 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments/8ce65a9f-8b26-421c-b9d2-9a7c692d8104 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:35.701988 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-395beef9-3b6e-4936-87d2-df4b3529fdf2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7785c8ea-616e-4d28-904f-a75472fca41c"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:35.703032 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-395beef9-3b6e-4936-87d2-df4b3529fdf2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:35.709469 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-395beef9-3b6e-4936-87d2-df4b3529fdf2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:35.709908 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-395beef9-3b6e-4936-87d2-df4b3529fdf2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:35.710658 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-395beef9-3b6e-4936-87d2-df4b3529fdf2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:35.711087 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-395beef9-3b6e-4936-87d2-df4b3529fdf2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:35.968305 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-395beef9-3b6e-4936-87d2-df4b3529fdf2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "POST /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269951 Jun 16 15:07:35.968910 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 562/1125] 10.222.0.76 () {60 vars in 1322 bytes} [Thu Jun 16 15:07:35 2022] POST /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:43.459961 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-fb2548ef-0ae4-499e-92e2-d6ee01cdb9eb tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:43.460875 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-fb2548ef-0ae4-499e-92e2-d6ee01cdb9eb tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:43.467658 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fb2548ef-0ae4-499e-92e2-d6ee01cdb9eb tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:43.468130 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fb2548ef-0ae4-499e-92e2-d6ee01cdb9eb tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:43.468878 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fb2548ef-0ae4-499e-92e2-d6ee01cdb9eb tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:43.469305 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-fb2548ef-0ae4-499e-92e2-d6ee01cdb9eb tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:43.499558 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-fb2548ef-0ae4-499e-92e2-d6ee01cdb9eb tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043616 Jun 16 15:07:43.500121 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 564/1126] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:07:43 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:43.640747 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f648925c-a6bc-489f-a8a0-f97b2811a5d1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:43.641325 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f648925c-a6bc-489f-a8a0-f97b2811a5d1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:43.647595 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f648925c-a6bc-489f-a8a0-f97b2811a5d1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:43.648082 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f648925c-a6bc-489f-a8a0-f97b2811a5d1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:43.648846 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f648925c-a6bc-489f-a8a0-f97b2811a5d1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:43.649293 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f648925c-a6bc-489f-a8a0-f97b2811a5d1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:43.678507 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f648925c-a6bc-489f-a8a0-f97b2811a5d1 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments/8ce65a9f-8b26-421c-b9d2-9a7c692d8104" status: 200 len: 194 microversion: 2.1 time: 0.042612 Jun 16 15:07:43.679088 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 563/1127] 10.222.0.76 () {58 vars in 1412 bytes} [Thu Jun 16 15:07:43 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments/8ce65a9f-8b26-421c-b9d2-9a7c692d8104 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:43.695544 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-6975daff-c792-4936-b4bd-ef28840e4dde tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:43.696056 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-6975daff-c792-4936-b4bd-ef28840e4dde tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:43.702208 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6975daff-c792-4936-b4bd-ef28840e4dde tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:43.702658 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6975daff-c792-4936-b4bd-ef28840e4dde tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:43.703414 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6975daff-c792-4936-b4bd-ef28840e4dde tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:43.703893 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-6975daff-c792-4936-b4bd-ef28840e4dde tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:43.782450 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.objects.instance [None req-6975daff-c792-4936-b4bd-ef28840e4dde tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lazy-loading 'services' on Instance uuid 811e0c92-bd5b-4188-b909-86451f68b9c5 {{(pid=117443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:07:43.858065 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-6975daff-c792-4936-b4bd-ef28840e4dde tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "DELETE /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments/8ce65a9f-8b26-421c-b9d2-9a7c692d8104" status: 202 len: 0 microversion: 2.1 time: 0.171242 Jun 16 15:07:43.859091 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 565/1128] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Jun 16 15:07:43 2022] DELETE /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments/8ce65a9f-8b26-421c-b9d2-9a7c692d8104 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:07:44.969300 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1e6ba928-2bb0-4402-bae8-e53b12fdb5f0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:44.969831 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1e6ba928-2bb0-4402-bae8-e53b12fdb5f0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:44.976249 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1e6ba928-2bb0-4402-bae8-e53b12fdb5f0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:44.976700 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1e6ba928-2bb0-4402-bae8-e53b12fdb5f0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:44.977464 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1e6ba928-2bb0-4402-bae8-e53b12fdb5f0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:44.977901 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1e6ba928-2bb0-4402-bae8-e53b12fdb5f0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:45.005565 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1e6ba928-2bb0-4402-bae8-e53b12fdb5f0 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments/7785c8ea-616e-4d28-904f-a75472fca41c" status: 200 len: 194 microversion: 2.1 time: 0.040323 Jun 16 15:07:45.006126 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 564/1129] 10.222.0.76 () {58 vars in 1412 bytes} [Thu Jun 16 15:07:44 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments/7785c8ea-616e-4d28-904f-a75472fca41c => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:45.016826 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8c17a225-7ceb-472a-b28e-6ba1e246a036 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:45.017410 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-8c17a225-7ceb-472a-b28e-6ba1e246a036 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:45.024695 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c17a225-7ceb-472a-b28e-6ba1e246a036 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:45.025151 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c17a225-7ceb-472a-b28e-6ba1e246a036 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:45.025922 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c17a225-7ceb-472a-b28e-6ba1e246a036 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:45.026360 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8c17a225-7ceb-472a-b28e-6ba1e246a036 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:45.104546 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.objects.instance [None req-8c17a225-7ceb-472a-b28e-6ba1e246a036 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lazy-loading 'services' on Instance uuid 811e0c92-bd5b-4188-b909-86451f68b9c5 {{(pid=117443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:07:45.180722 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8c17a225-7ceb-472a-b28e-6ba1e246a036 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "DELETE /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments/7785c8ea-616e-4d28-904f-a75472fca41c" status: 202 len: 0 microversion: 2.1 time: 0.167336 Jun 16 15:07:45.181411 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 566/1130] 10.222.0.76 () {58 vars in 1415 bytes} [Thu Jun 16 15:07:45 2022] DELETE /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments/7785c8ea-616e-4d28-904f-a75472fca41c => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:07:46.338387 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-546b0218-943d-4102-a58e-0a831588dca2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:46.339321 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-546b0218-943d-4102-a58e-0a831588dca2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:46.345939 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-546b0218-943d-4102-a58e-0a831588dca2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:46.346390 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-546b0218-943d-4102-a58e-0a831588dca2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:46.347156 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-546b0218-943d-4102-a58e-0a831588dca2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:46.347595 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-546b0218-943d-4102-a58e-0a831588dca2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:46.375211 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-546b0218-943d-4102-a58e-0a831588dca2 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041407 Jun 16 15:07:46.375786 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 565/1131] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:07:46 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 15:07:46.479157 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-29104539-3959-423c-bd5f-93e08a50f553 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:46.480342 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-29104539-3959-423c-bd5f-93e08a50f553 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:46.486441 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-29104539-3959-423c-bd5f-93e08a50f553 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:46.486882 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-29104539-3959-423c-bd5f-93e08a50f553 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:46.487658 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-29104539-3959-423c-bd5f-93e08a50f553 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:46.488105 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-29104539-3959-423c-bd5f-93e08a50f553 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:46.518961 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-29104539-3959-423c-bd5f-93e08a50f553 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044341 Jun 16 15:07:46.519416 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 567/1132] 10.222.0.76 () {58 vars in 1301 bytes} [Thu Jun 16 15:07:46 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 15:07:46.575722 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-63333f66-97b1-4a18-8976-74c22d2f1927 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:46.576227 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-63333f66-97b1-4a18-8976-74c22d2f1927 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:46.582092 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-63333f66-97b1-4a18-8976-74c22d2f1927 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:46.582543 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-63333f66-97b1-4a18-8976-74c22d2f1927 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:46.583309 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-63333f66-97b1-4a18-8976-74c22d2f1927 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:46.583770 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-63333f66-97b1-4a18-8976-74c22d2f1927 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:46.608356 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-63333f66-97b1-4a18-8976-74c22d2f1927 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:07:46.686530 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-63333f66-97b1-4a18-8976-74c22d2f1927 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "DELETE /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5" status: 204 len: 0 microversion: 2.1 time: 0.114099 Jun 16 15:07:46.687594 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 566/1133] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:07:46 2022] DELETE /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:07:46.697375 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-2dfd2cf7-5fad-43e2-ab47-7375b8db6f8f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:46.698020 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-2dfd2cf7-5fad-43e2-ab47-7375b8db6f8f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:46.703963 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2dfd2cf7-5fad-43e2-ab47-7375b8db6f8f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:46.704431 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2dfd2cf7-5fad-43e2-ab47-7375b8db6f8f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:46.705238 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2dfd2cf7-5fad-43e2-ab47-7375b8db6f8f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:46.705672 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-2dfd2cf7-5fad-43e2-ab47-7375b8db6f8f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:46.835960 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-2dfd2cf7-5fad-43e2-ab47-7375b8db6f8f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:46.843821 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-2dfd2cf7-5fad-43e2-ab47-7375b8db6f8f tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5" status: 200 len: 1673 microversion: 2.1 time: 0.151489 Jun 16 15:07:46.844378 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 568/1134] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:46 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:47.861540 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e3e382fc-0d34-49bb-a9b3-dd00d71cbf6d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:47.862252 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e3e382fc-0d34-49bb-a9b3-dd00d71cbf6d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:47.868807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e3e382fc-0d34-49bb-a9b3-dd00d71cbf6d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:47.869261 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e3e382fc-0d34-49bb-a9b3-dd00d71cbf6d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:47.870028 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e3e382fc-0d34-49bb-a9b3-dd00d71cbf6d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:47.870464 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e3e382fc-0d34-49bb-a9b3-dd00d71cbf6d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:48.009899 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e3e382fc-0d34-49bb-a9b3-dd00d71cbf6d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:48.017295 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e3e382fc-0d34-49bb-a9b3-dd00d71cbf6d tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5" status: 200 len: 1673 microversion: 2.1 time: 0.160095 Jun 16 15:07:48.017859 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 567/1135] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:47 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:49.034326 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4a20462d-61f2-4181-9e91-7fe808910a72 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:49.034940 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4a20462d-61f2-4181-9e91-7fe808910a72 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:49.042073 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4a20462d-61f2-4181-9e91-7fe808910a72 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:49.042535 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4a20462d-61f2-4181-9e91-7fe808910a72 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:49.043310 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4a20462d-61f2-4181-9e91-7fe808910a72 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:49.043993 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4a20462d-61f2-4181-9e91-7fe808910a72 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:49.382174 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4a20462d-61f2-4181-9e91-7fe808910a72 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8bd17e43c3a4c22bedf4d8011a6f064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2ff2a55903449bb4c5364e64645931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:49.390191 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4a20462d-61f2-4181-9e91-7fe808910a72 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5" status: 200 len: 1605 microversion: 2.1 time: 0.359630 Jun 16 15:07:49.390970 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 569/1136] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:49 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 => generated 1605 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:49.610804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-32b4d9b6-aa79-4ec7-aa6f-6fd7f4cf5d7d req-97974cdc-e2b1-4068-8862-aa58a33e489d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811e0c92-bd5b-4188-b909-86451f68b9c5", "name": "network-vif-deleted", "tag": "672f1667-8ade-4398-a319-4be060e56dd9"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:49.621349 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-32b4d9b6-aa79-4ec7-aa6f-6fd7f4cf5d7d req-97974cdc-e2b1-4068-8862-aa58a33e489d service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:49.621804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-32b4d9b6-aa79-4ec7-aa6f-6fd7f4cf5d7d req-97974cdc-e2b1-4068-8862-aa58a33e489d service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:49.634387 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-32b4d9b6-aa79-4ec7-aa6f-6fd7f4cf5d7d req-97974cdc-e2b1-4068-8862-aa58a33e489d service nova] Creating event network-vif-deleted:672f1667-8ade-4398-a319-4be060e56dd9 for instance 811e0c92-bd5b-4188-b909-86451f68b9c5 on hv-cinder-83716 Jun 16 15:07:49.640265 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-32b4d9b6-aa79-4ec7-aa6f-6fd7f4cf5d7d req-97974cdc-e2b1-4068-8862-aa58a33e489d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032923 Jun 16 15:07:49.641177 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 568/1137] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:50.406977 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-aa5049ce-3542-4afc-b2a8-2f6e8447d533 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:50.407575 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-aa5049ce-3542-4afc-b2a8-2f6e8447d533 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:50.414993 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aa5049ce-3542-4afc-b2a8-2f6e8447d533 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:50.415440 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aa5049ce-3542-4afc-b2a8-2f6e8447d533 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:50.416240 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aa5049ce-3542-4afc-b2a8-2f6e8447d533 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:50.416666 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aa5049ce-3542-4afc-b2a8-2f6e8447d533 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:50.431695 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-aa5049ce-3542-4afc-b2a8-2f6e8447d533 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] HTTP exception thrown: Instance 811e0c92-bd5b-4188-b909-86451f68b9c5 could not be found. Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-aa5049ce-3542-4afc-b2a8-2f6e8447d533 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Request method failure captured: Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 HTTP/1.1 Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0Zad52qz65TyY076obNvggHLh-Aog-PNWUKB2qe4CzRETfVo6c0wf1F1XXs2ZxwQaFFNKB9xMpg2stvWOO_MzX7X8PkYDbNreKCTlGMruHf9XxbZpf7yTYB8Z11x00fOqU9LAwq5p_axLIIdKw0PsUlQwTTL4MdMIZ6yRswPq3Tf9s Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 1e2ff2a55903449bb4c5364e64645931 Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-AttachVolumeTestJSON-1738513634 Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 15:07:50.433527 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 15:07:50.435177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:07:50.435177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-AttachVolumeTestJSON-1738513634 Jun 16 15:07:50.435177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 1e2ff2a55903449bb4c5364e64645931 Jun 16 15:07:50.435177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1738513634 Jun 16 15:07:50.435177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-AttachVolumeTestJSON-1738513634-project Jun 16 15:07:50.435177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 15:07:50.435177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 15:07:50.435177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: b8bd17e43c3a4c22bedf4d8011a6f064 Jun 16 15:07:50.435177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-AttachVolumeTestJSON-1738513634-project Jun 16 15:07:50.435177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 15:07:50.435177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance 811e0c92-bd5b-4188-b909-86451f68b9c5 could not be found. Jun 16 15:07:50.435177 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': '811e0c92-bd5b-4188-b909-86451f68b9c5'} Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 811e0c92-bd5b-4188-b909-86451f68b9c5 could not be found. Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:07:50.436242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:07:50.437808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:07:50.437808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:07:50.437808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:07:50.437808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:07:50.437808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:07:50.437808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:07:50.437808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:07:50.437808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 811e0c92-bd5b-4188-b909-86451f68b9c5 could not be found. Jun 16 15:07:50.437808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:07:50.437808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:07:50.437808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:07:50.437808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:07:50.437808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:07:50.437808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:07:50.437808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:07:50.437808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:07:50.437808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 811e0c92-bd5b-4188-b909-86451f68b9c5 could not be found. Jun 16 15:07:50.437808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:07:50.439504 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-aa5049ce-3542-4afc-b2a8-2f6e8447d533 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Returning 404 to user: Instance 811e0c92-bd5b-4188-b909-86451f68b9c5 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:07:50.439504 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-aa5049ce-3542-4afc-b2a8-2f6e8447d533 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5" status: 404 len: 111 microversion: 2.1 time: 0.032448 Jun 16 15:07:50.439504 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 570/1138] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:50 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 15:07:50.444130 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-fc21b98c-0c37-48d2-8ecd-cd20ce79c353 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '.version_select at 0x7f33e16824c0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:50.462075 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-fc21b98c-0c37-48d2-8ecd-cd20ce79c353 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2016135264" status: 202 len: 0 microversion: 2.1 time: 0.021953 Jun 16 15:07:50.462594 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 569/1139] 10.222.0.76 () {58 vars in 1220 bytes} [Thu Jun 16 15:07:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2016135264 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:07:53.337159 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b962ef48-3fff-4a60-a644-4b4bdd613cc9 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:53.337694 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b962ef48-3fff-4a60-a644-4b4bdd613cc9 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:53.344408 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b962ef48-3fff-4a60-a644-4b4bdd613cc9 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:53.344856 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b962ef48-3fff-4a60-a644-4b4bdd613cc9 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:53.345616 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b962ef48-3fff-4a60-a644-4b4bdd613cc9 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:53.346054 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b962ef48-3fff-4a60-a644-4b4bdd613cc9 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:53.359933 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-b962ef48-3fff-4a60-a644-4b4bdd613cc9 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] HTTP exception thrown: Instance 811e0c92-bd5b-4188-b909-86451f68b9c5 could not be found. Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b962ef48-3fff-4a60-a644-4b4bdd613cc9 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Request method failure captured: Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: DELETE /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 HTTP/1.1 Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0Zad52qz65TyY076obNvggHLh-Aog-PNWUKB2qe4CzRETfVo6c0wf1F1XXs2ZxwQaFFNKB9xMpg2stvWOO_MzX7X8PkYDbNreKCTlGMruHf9XxbZpf7yTYB8Z11x00fOqU9LAwq5p_axLIIdKw0PsUlQwTTL4MdMIZ6yRswPq3Tf9s Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 1e2ff2a55903449bb4c5364e64645931 Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-AttachVolumeTestJSON-1738513634 Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 15:07:53.361455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 15:07:53.363153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:07:53.363153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-AttachVolumeTestJSON-1738513634 Jun 16 15:07:53.363153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 1e2ff2a55903449bb4c5364e64645931 Jun 16 15:07:53.363153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1738513634 Jun 16 15:07:53.363153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-AttachVolumeTestJSON-1738513634-project Jun 16 15:07:53.363153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 15:07:53.363153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 15:07:53.363153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: b8bd17e43c3a4c22bedf4d8011a6f064 Jun 16 15:07:53.363153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-AttachVolumeTestJSON-1738513634-project Jun 16 15:07:53.363153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 15:07:53.363153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance 811e0c92-bd5b-4188-b909-86451f68b9c5 could not be found. Jun 16 15:07:53.363153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': '811e0c92-bd5b-4188-b909-86451f68b9c5'} Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 811e0c92-bd5b-4188-b909-86451f68b9c5 could not be found. Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:07:53.364126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 811e0c92-bd5b-4188-b909-86451f68b9c5 could not be found. Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 811e0c92-bd5b-4188-b909-86451f68b9c5 could not be found. Jun 16 15:07:53.365623 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:07:53.367252 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b962ef48-3fff-4a60-a644-4b4bdd613cc9 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Returning 404 to user: Instance 811e0c92-bd5b-4188-b909-86451f68b9c5 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:07:53.367252 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b962ef48-3fff-4a60-a644-4b4bdd613cc9 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "DELETE /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5" status: 404 len: 111 microversion: 2.1 time: 0.029453 Jun 16 15:07:53.367252 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 571/1140] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:07:53 2022] DELETE /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:07:53.371692 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-97f253c2-b12c-4c06-a811-91063610a682 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:53.372438 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-97f253c2-b12c-4c06-a811-91063610a682 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 811e0c92-bd5b-4188-b909-86451f68b9c5] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:53.379491 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-97f253c2-b12c-4c06-a811-91063610a682 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:53.379961 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-97f253c2-b12c-4c06-a811-91063610a682 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:53.380720 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-97f253c2-b12c-4c06-a811-91063610a682 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:53.381157 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-97f253c2-b12c-4c06-a811-91063610a682 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:53.394074 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-97f253c2-b12c-4c06-a811-91063610a682 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] HTTP exception thrown: Instance 811e0c92-bd5b-4188-b909-86451f68b9c5 could not be found. Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-97f253c2-b12c-4c06-a811-91063610a682 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Request method failure captured: Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 HTTP/1.1 Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0Zad52qz65TyY076obNvggHLh-Aog-PNWUKB2qe4CzRETfVo6c0wf1F1XXs2ZxwQaFFNKB9xMpg2stvWOO_MzX7X8PkYDbNreKCTlGMruHf9XxbZpf7yTYB8Z11x00fOqU9LAwq5p_axLIIdKw0PsUlQwTTL4MdMIZ6yRswPq3Tf9s Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 1e2ff2a55903449bb4c5364e64645931 Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeTestJSON-1738513634 Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:07:53.395660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:07:53.397245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:07:53.397245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeTestJSON-1738513634 Jun 16 15:07:53.397245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 1e2ff2a55903449bb4c5364e64645931 Jun 16 15:07:53.397245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1738513634 Jun 16 15:07:53.397245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeTestJSON-1738513634-project Jun 16 15:07:53.397245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:07:53.397245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:07:53.397245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: b8bd17e43c3a4c22bedf4d8011a6f064 Jun 16 15:07:53.397245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeTestJSON-1738513634-project Jun 16 15:07:53.397245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:07:53.397245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance 811e0c92-bd5b-4188-b909-86451f68b9c5 could not be found. Jun 16 15:07:53.397245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': '811e0c92-bd5b-4188-b909-86451f68b9c5'} Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 811e0c92-bd5b-4188-b909-86451f68b9c5 could not be found. Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:07:53.398160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:07:53.399764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:07:53.399764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:07:53.399764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:07:53.399764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:07:53.399764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:07:53.399764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:07:53.399764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:07:53.399764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 811e0c92-bd5b-4188-b909-86451f68b9c5 could not be found. Jun 16 15:07:53.399764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:07:53.399764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:07:53.399764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:07:53.399764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:07:53.399764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:07:53.399764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:07:53.399764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:07:53.399764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:07:53.399764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 811e0c92-bd5b-4188-b909-86451f68b9c5 could not be found. Jun 16 15:07:53.399764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:07:53.401112 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-97f253c2-b12c-4c06-a811-91063610a682 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Returning 404 to user: Instance 811e0c92-bd5b-4188-b909-86451f68b9c5 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:07:53.401112 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-97f253c2-b12c-4c06-a811-91063610a682 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5" status: 404 len: 111 microversion: 2.1 time: 0.029700 Jun 16 15:07:53.401112 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 570/1141] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:53 2022] GET /compute/v2.1/servers/811e0c92-bd5b-4188-b909-86451f68b9c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:07:54.529942 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-0778f34c-cd2f-4b0a-84d5-f02142263d2c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:54.530455 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-0778f34c-cd2f-4b0a-84d5-f02142263d2c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:54.537403 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0778f34c-cd2f-4b0a-84d5-f02142263d2c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:54.537847 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0778f34c-cd2f-4b0a-84d5-f02142263d2c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:54.538601 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0778f34c-cd2f-4b0a-84d5-f02142263d2c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:54.539729 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0778f34c-cd2f-4b0a-84d5-f02142263d2c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:54.553261 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-0778f34c-cd2f-4b0a-84d5-f02142263d2c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] HTTP exception thrown: Instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 could not be found. Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-0778f34c-cd2f-4b0a-84d5-f02142263d2c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Request method failure captured: Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: DELETE /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 HTTP/1.1 Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0Zad52qz65TyY076obNvggHLh-Aog-PNWUKB2qe4CzRETfVo6c0wf1F1XXs2ZxwQaFFNKB9xMpg2stvWOO_MzX7X8PkYDbNreKCTlGMruHf9XxbZpf7yTYB8Z11x00fOqU9LAwq5p_axLIIdKw0PsUlQwTTL4MdMIZ6yRswPq3Tf9s Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 1e2ff2a55903449bb4c5364e64645931 Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-AttachVolumeTestJSON-1738513634 Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 15:07:54.555047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 15:07:54.556483 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:07:54.556483 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-AttachVolumeTestJSON-1738513634 Jun 16 15:07:54.556483 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 1e2ff2a55903449bb4c5364e64645931 Jun 16 15:07:54.556483 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1738513634 Jun 16 15:07:54.556483 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-AttachVolumeTestJSON-1738513634-project Jun 16 15:07:54.556483 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 15:07:54.556483 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 15:07:54.556483 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: b8bd17e43c3a4c22bedf4d8011a6f064 Jun 16 15:07:54.556483 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-AttachVolumeTestJSON-1738513634-project Jun 16 15:07:54.556483 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 15:07:54.556483 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 could not be found. Jun 16 15:07:54.556483 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': '80fc06fb-d5ab-4b9e-bdc2-bb043f52da15'} Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 could not be found. Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:07:54.557972 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 could not be found. Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 could not be found. Jun 16 15:07:54.559473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:07:54.560992 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-0778f34c-cd2f-4b0a-84d5-f02142263d2c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Returning 404 to user: Instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:07:54.560992 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-0778f34c-cd2f-4b0a-84d5-f02142263d2c tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "DELETE /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 404 len: 111 microversion: 2.1 time: 0.030353 Jun 16 15:07:54.560992 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 572/1142] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:07:54 2022] DELETE /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:07:54.565095 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-57ac890a-b874-4722-a3de-c0f4cb89e958 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:54.565709 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-57ac890a-b874-4722-a3de-c0f4cb89e958 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] [instance: 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:54.572629 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-57ac890a-b874-4722-a3de-c0f4cb89e958 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:54.573083 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-57ac890a-b874-4722-a3de-c0f4cb89e958 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:54.574117 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-57ac890a-b874-4722-a3de-c0f4cb89e958 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:54.574555 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-57ac890a-b874-4722-a3de-c0f4cb89e958 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:54.588179 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-57ac890a-b874-4722-a3de-c0f4cb89e958 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] HTTP exception thrown: Instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 could not be found. Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-57ac890a-b874-4722-a3de-c0f4cb89e958 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Request method failure captured: Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 HTTP/1.1 Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0Zad52qz65TyY076obNvggHLh-Aog-PNWUKB2qe4CzRETfVo6c0wf1F1XXs2ZxwQaFFNKB9xMpg2stvWOO_MzX7X8PkYDbNreKCTlGMruHf9XxbZpf7yTYB8Z11x00fOqU9LAwq5p_axLIIdKw0PsUlQwTTL4MdMIZ6yRswPq3Tf9s Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 1e2ff2a55903449bb4c5364e64645931 Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeTestJSON-1738513634 Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:07:54.589681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:07:54.591313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1e2ff2a55903449bb4c5364e64645931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:07:54.591313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeTestJSON-1738513634 Jun 16 15:07:54.591313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 1e2ff2a55903449bb4c5364e64645931 Jun 16 15:07:54.591313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1738513634 Jun 16 15:07:54.591313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeTestJSON-1738513634-project Jun 16 15:07:54.591313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:07:54.591313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:07:54.591313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: b8bd17e43c3a4c22bedf4d8011a6f064 Jun 16 15:07:54.591313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeTestJSON-1738513634-project Jun 16 15:07:54.591313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:07:54.591313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 could not be found. Jun 16 15:07:54.591313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': '80fc06fb-d5ab-4b9e-bdc2-bb043f52da15'} Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 could not be found. Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:07:54.592557 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:07:54.594012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:07:54.594012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:07:54.594012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:07:54.594012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:07:54.594012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:07:54.594012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:07:54.594012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:07:54.594012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 could not be found. Jun 16 15:07:54.594012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:07:54.594012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:07:54.594012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:07:54.594012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:07:54.594012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:07:54.594012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:07:54.594012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:07:54.594012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:07:54.594012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 could not be found. Jun 16 15:07:54.594012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:07:54.595571 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-57ac890a-b874-4722-a3de-c0f4cb89e958 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] Returning 404 to user: Instance 80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:07:54.595571 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-57ac890a-b874-4722-a3de-c0f4cb89e958 tempest-AttachVolumeTestJSON-1738513634 tempest-AttachVolumeTestJSON-1738513634-project] 10.222.0.76 "GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15" status: 404 len: 111 microversion: 2.1 time: 0.030042 Jun 16 15:07:54.595571 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 571/1143] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:54 2022] GET /compute/v2.1/servers/80fc06fb-d5ab-4b9e-bdc2-bb043f52da15 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:08:52.034541 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=22 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:52.035834 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:52.248028 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b88e6172-7c46-4fd6-b1a2-99da24785d08 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Action: 'create', calling method: .version_select at 0x7f33e1308a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1475024670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHncSqDitf5YUeaFB2dmLsAoEXugzfIoxzxUEI7sKL2Igx81TC/qDOLaGyIRU12sifKSn4WixHJQb4FggrfrgV8sICCg3icfmIEbhbsd6Lw8nY4f3Z7kuH0JVkmHezjvNA=="}} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:08:52.262951 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-b88e6172-7c46-4fd6-b1a2-99da24785d08 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Getting quotas for project 52a575aa707340efb2cf89faf6a016bc. Resources: {'key_pairs'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:08:52.266980 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.quota [None req-b88e6172-7c46-4fd6-b1a2-99da24785d08 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Getting quotas for user ee7a7cad42794792b05393a4b1582bc6 and project 52a575aa707340efb2cf89faf6a016bc. Resources: {'key_pairs'} {{(pid=117443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:08:52.291419 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b88e6172-7c46-4fd6-b1a2-99da24785d08 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.265796 Jun 16 15:08:52.292176 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 573/1144] 10.222.0.76 () {60 vars in 1158 bytes} [Thu Jun 16 15:08:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:07.419163 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:07.419942 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:07.425335 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-45e32759-9c4d-4f7d-bcb4-fe06711171f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-802223202", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1475024670", "security_groups": [{"name": "tempest-secgroup-smoke-324105474"}], "block_device_mapping_v2": [{"uuid": "1603a838-f426-4c07-ad99-bbc68946ac93", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e3e15102-1b6a-4468-bb13-36ba3b3e3528"}]}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:09:07.538528 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-45e32759-9c4d-4f7d-bcb4-fe06711171f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] validate_networks() for [('e3e15102-1b6a-4468-bb13-36ba3b3e3528', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:09:07.998624 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-45e32759-9c4d-4f7d-bcb4-fe06711171f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:09:07.999187 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-45e32759-9c4d-4f7d-bcb4-fe06711171f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:09:07.999662 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-45e32759-9c4d-4f7d-bcb4-fe06711171f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:09:08.000098 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-45e32759-9c4d-4f7d-bcb4-fe06711171f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:09:08.000512 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-45e32759-9c4d-4f7d-bcb4-fe06711171f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:09:08.010661 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-45e32759-9c4d-4f7d-bcb4-fe06711171f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:08.011111 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-45e32759-9c4d-4f7d-bcb4-fe06711171f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:08.011941 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-45e32759-9c4d-4f7d-bcb4-fe06711171f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:08.012380 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-45e32759-9c4d-4f7d-bcb4-fe06711171f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:08.029123 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-45e32759-9c4d-4f7d-bcb4-fe06711171f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Getting quotas for project 52a575aa707340efb2cf89faf6a016bc. Resources: {'ram', 'cores', 'instances'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:09:08.033043 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-45e32759-9c4d-4f7d-bcb4-fe06711171f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Getting quotas for user ee7a7cad42794792b05393a4b1582bc6 and project 52a575aa707340efb2cf89faf6a016bc. Resources: {'ram', 'cores', 'instances'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:09:08.089177 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-45e32759-9c4d-4f7d-bcb4-fe06711171f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:09:08.091310 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-45e32759-9c4d-4f7d-bcb4-fe06711171f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1603a838-f426-4c07-ad99-bbc68946ac93',volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:09:08.216021 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR oslo.messaging._drivers.impl_rabbit [None req-45e32759-9c4d-4f7d-bcb4-fe06711171f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [9a6fcd8f-1eef-4c48-a93f-8a16be003b9c] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 15:09:09.223373 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO oslo.messaging._drivers.impl_rabbit [None req-45e32759-9c4d-4f7d-bcb4-fe06711171f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [9a6fcd8f-1eef-4c48-a93f-8a16be003b9c] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 39382. Jun 16 15:09:09.227701 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-45e32759-9c4d-4f7d-bcb4-fe06711171f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.811113 Jun 16 15:09:09.228414 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 572/1145] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 15:09:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 15:09:09.236176 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=4 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:09.236909 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:09.240910 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-5b278ad2-bc54-4924-b75d-1870aeae0947 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:09.241511 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-5b278ad2-bc54-4924-b75d-1870aeae0947 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:09.296367 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-5b278ad2-bc54-4924-b75d-1870aeae0947 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:09.302865 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-5b278ad2-bc54-4924-b75d-1870aeae0947 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1094 microversion: 2.1 time: 0.068101 Jun 16 15:09:09.303405 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 574/1146] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:09 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:10.322943 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8fc2e903-90c8-4eba-b9dc-5a2ee5c03812 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:10.324083 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8fc2e903-90c8-4eba-b9dc-5a2ee5c03812 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:10.378716 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8fc2e903-90c8-4eba-b9dc-5a2ee5c03812 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:10.385959 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8fc2e903-90c8-4eba-b9dc-5a2ee5c03812 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1094 microversion: 2.1 time: 0.068964 Jun 16 15:09:10.386516 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 573/1147] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:10 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:11.402525 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-12cdbf0a-8e9e-4644-9605-87bb063fa56e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:11.403153 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-12cdbf0a-8e9e-4644-9605-87bb063fa56e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:11.458120 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-12cdbf0a-8e9e-4644-9605-87bb063fa56e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:11.465894 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-12cdbf0a-8e9e-4644-9605-87bb063fa56e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1094 microversion: 2.1 time: 0.067611 Jun 16 15:09:11.466522 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 575/1148] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:11 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:12.447705 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:09:12.448392 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Thu Jun 16 15:09:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:09:12.482871 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f5f2acd1-2938-40ad-8b33-48632004f598 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:12.483480 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f5f2acd1-2938-40ad-8b33-48632004f598 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:12.544424 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f5f2acd1-2938-40ad-8b33-48632004f598 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:12.551729 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f5f2acd1-2938-40ad-8b33-48632004f598 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1094 microversion: 2.1 time: 0.073279 Jun 16 15:09:12.552456 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 574/1149] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:12 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:13.569485 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a42d1e55-ac85-43c5-8986-95f657b4fc8f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:13.570025 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a42d1e55-ac85-43c5-8986-95f657b4fc8f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:13.577242 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a42d1e55-ac85-43c5-8986-95f657b4fc8f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:13.577691 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a42d1e55-ac85-43c5-8986-95f657b4fc8f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:13.578448 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a42d1e55-ac85-43c5-8986-95f657b4fc8f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:13.578886 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a42d1e55-ac85-43c5-8986-95f657b4fc8f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:13.638244 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a42d1e55-ac85-43c5-8986-95f657b4fc8f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:13.645895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a42d1e55-ac85-43c5-8986-95f657b4fc8f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1144 microversion: 2.1 time: 0.080313 Jun 16 15:09:13.646450 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 576/1150] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:13 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:14.663559 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2652c79e-b40a-40ff-ae71-72e16b344140 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:14.664995 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2652c79e-b40a-40ff-ae71-72e16b344140 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:14.675793 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2652c79e-b40a-40ff-ae71-72e16b344140 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:14.676279 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2652c79e-b40a-40ff-ae71-72e16b344140 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:14.677063 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2652c79e-b40a-40ff-ae71-72e16b344140 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:14.677681 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2652c79e-b40a-40ff-ae71-72e16b344140 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:14.754835 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2652c79e-b40a-40ff-ae71-72e16b344140 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:14.763755 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2652c79e-b40a-40ff-ae71-72e16b344140 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1210 microversion: 2.1 time: 0.104408 Jun 16 15:09:14.764329 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 575/1151] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:14 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:15.781778 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-0501fe23-8aeb-4cbf-89b2-774135a973ed tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:15.782381 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-0501fe23-8aeb-4cbf-89b2-774135a973ed tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:15.789223 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0501fe23-8aeb-4cbf-89b2-774135a973ed tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:15.789816 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0501fe23-8aeb-4cbf-89b2-774135a973ed tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:15.790584 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0501fe23-8aeb-4cbf-89b2-774135a973ed tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:15.791015 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0501fe23-8aeb-4cbf-89b2-774135a973ed tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:16.017206 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-0501fe23-8aeb-4cbf-89b2-774135a973ed tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:16.025779 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-0501fe23-8aeb-4cbf-89b2-774135a973ed tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1265 microversion: 2.1 time: 0.247607 Jun 16 15:09:16.036110 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 577/1152] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:15 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:16.166387 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-4145d24a-e319-488b-91b7-b386dde0f05e req-cabfac62-7858-4fef-a07c-2996690c1f43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edd1b913-1070-4e9f-a177-05eeeb807618", "tag": "6aa09cb0-494a-49a8-9404-dde31f6924e0"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:09:16.177390 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-4145d24a-e319-488b-91b7-b386dde0f05e req-cabfac62-7858-4fef-a07c-2996690c1f43 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:16.178073 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-4145d24a-e319-488b-91b7-b386dde0f05e req-cabfac62-7858-4fef-a07c-2996690c1f43 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:16.191940 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-4145d24a-e319-488b-91b7-b386dde0f05e req-cabfac62-7858-4fef-a07c-2996690c1f43 service nova] Creating event network-changed:6aa09cb0-494a-49a8-9404-dde31f6924e0 for instance edd1b913-1070-4e9f-a177-05eeeb807618 on hv-cinder-83716 Jun 16 15:09:16.197056 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-4145d24a-e319-488b-91b7-b386dde0f05e req-cabfac62-7858-4fef-a07c-2996690c1f43 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034821 Jun 16 15:09:16.197666 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 576/1153] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:17.042573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-88ff77fd-39ae-46a4-b1ca-1f78d7493873 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:17.043184 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-88ff77fd-39ae-46a4-b1ca-1f78d7493873 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:17.049720 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-88ff77fd-39ae-46a4-b1ca-1f78d7493873 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:17.050161 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-88ff77fd-39ae-46a4-b1ca-1f78d7493873 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:17.050912 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-88ff77fd-39ae-46a4-b1ca-1f78d7493873 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:17.051336 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-88ff77fd-39ae-46a4-b1ca-1f78d7493873 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:17.247471 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-88ff77fd-39ae-46a4-b1ca-1f78d7493873 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:17.255112 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-88ff77fd-39ae-46a4-b1ca-1f78d7493873 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1265 microversion: 2.1 time: 0.216695 Jun 16 15:09:17.255793 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 578/1154] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:17 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:18.270250 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:18.274862 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-77ac69ab-e14d-41a2-afeb-065f9d91b0f5 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:18.275571 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-77ac69ab-e14d-41a2-afeb-065f9d91b0f5 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:18.282662 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-77ac69ab-e14d-41a2-afeb-065f9d91b0f5 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:18.283125 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-77ac69ab-e14d-41a2-afeb-065f9d91b0f5 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:18.283914 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-77ac69ab-e14d-41a2-afeb-065f9d91b0f5 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:18.284349 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-77ac69ab-e14d-41a2-afeb-065f9d91b0f5 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:18.420486 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-77ac69ab-e14d-41a2-afeb-065f9d91b0f5 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:18.427814 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-77ac69ab-e14d-41a2-afeb-065f9d91b0f5 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1265 microversion: 2.1 time: 0.159019 Jun 16 15:09:18.428360 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 577/1155] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:18 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:19.444389 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d38b2f6e-8939-4684-823a-8fbc562026c3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:19.444994 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d38b2f6e-8939-4684-823a-8fbc562026c3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:19.451169 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d38b2f6e-8939-4684-823a-8fbc562026c3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:19.451613 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d38b2f6e-8939-4684-823a-8fbc562026c3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:19.452399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d38b2f6e-8939-4684-823a-8fbc562026c3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:19.452831 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d38b2f6e-8939-4684-823a-8fbc562026c3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:19.582794 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d38b2f6e-8939-4684-823a-8fbc562026c3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:19.590879 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d38b2f6e-8939-4684-823a-8fbc562026c3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1265 microversion: 2.1 time: 0.150324 Jun 16 15:09:19.591600 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 579/1156] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:19 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:20.607228 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2a1afbdb-b640-410a-b309-2a123144c048 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:20.607902 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2a1afbdb-b640-410a-b309-2a123144c048 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:20.613976 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2a1afbdb-b640-410a-b309-2a123144c048 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:20.614422 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2a1afbdb-b640-410a-b309-2a123144c048 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:20.615178 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2a1afbdb-b640-410a-b309-2a123144c048 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:20.615618 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2a1afbdb-b640-410a-b309-2a123144c048 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:20.749189 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2a1afbdb-b640-410a-b309-2a123144c048 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:20.756606 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2a1afbdb-b640-410a-b309-2a123144c048 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1265 microversion: 2.1 time: 0.153392 Jun 16 15:09:20.757185 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 578/1157] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:20 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:21.773278 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-b1791ad8-14b8-4772-965d-ddb7bd0c766a tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:21.773872 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-b1791ad8-14b8-4772-965d-ddb7bd0c766a tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:21.776221 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=4 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:21.781615 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b1791ad8-14b8-4772-965d-ddb7bd0c766a tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:21.782053 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b1791ad8-14b8-4772-965d-ddb7bd0c766a tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:21.782804 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b1791ad8-14b8-4772-965d-ddb7bd0c766a tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:21.783226 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-b1791ad8-14b8-4772-965d-ddb7bd0c766a tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:21.910056 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-b1791ad8-14b8-4772-965d-ddb7bd0c766a tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:21.918156 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-b1791ad8-14b8-4772-965d-ddb7bd0c766a tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1265 microversion: 2.1 time: 0.148783 Jun 16 15:09:21.918707 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 580/1158] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:21 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:22.934911 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-82fe49ae-a10c-465b-9584-ed516a793256 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:22.935539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-82fe49ae-a10c-465b-9584-ed516a793256 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:22.937820 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=10 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:22.943164 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-82fe49ae-a10c-465b-9584-ed516a793256 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:22.943605 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-82fe49ae-a10c-465b-9584-ed516a793256 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:22.944379 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-82fe49ae-a10c-465b-9584-ed516a793256 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:22.944807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-82fe49ae-a10c-465b-9584-ed516a793256 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:23.081902 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-82fe49ae-a10c-465b-9584-ed516a793256 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:23.089322 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-82fe49ae-a10c-465b-9584-ed516a793256 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1265 microversion: 2.1 time: 0.158779 Jun 16 15:09:23.089866 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 579/1159] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:22 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:24.106826 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-3b42c21e-2b47-43d0-9e5f-2187f3e2511e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:24.107431 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-3b42c21e-2b47-43d0-9e5f-2187f3e2511e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:24.113938 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3b42c21e-2b47-43d0-9e5f-2187f3e2511e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:24.114388 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3b42c21e-2b47-43d0-9e5f-2187f3e2511e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:24.115149 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3b42c21e-2b47-43d0-9e5f-2187f3e2511e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:24.115581 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-3b42c21e-2b47-43d0-9e5f-2187f3e2511e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:24.245140 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-3b42c21e-2b47-43d0-9e5f-2187f3e2511e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:24.252600 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-3b42c21e-2b47-43d0-9e5f-2187f3e2511e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1265 microversion: 2.1 time: 0.150140 Jun 16 15:09:24.253124 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 581/1160] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:24 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:25.269597 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-60e12726-e312-46de-86a7-16ca8b17cb1c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:25.270127 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-60e12726-e312-46de-86a7-16ca8b17cb1c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:25.276465 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-60e12726-e312-46de-86a7-16ca8b17cb1c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:25.276908 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-60e12726-e312-46de-86a7-16ca8b17cb1c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:25.277657 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-60e12726-e312-46de-86a7-16ca8b17cb1c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:25.278087 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-60e12726-e312-46de-86a7-16ca8b17cb1c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:25.405529 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-60e12726-e312-46de-86a7-16ca8b17cb1c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:25.413891 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-60e12726-e312-46de-86a7-16ca8b17cb1c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1265 microversion: 2.1 time: 0.148010 Jun 16 15:09:25.414542 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 580/1161] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:25 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:26.431248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c8615b1a-10a0-4973-8419-f15eb9c890b3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:26.431881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c8615b1a-10a0-4973-8419-f15eb9c890b3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:26.438877 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c8615b1a-10a0-4973-8419-f15eb9c890b3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:26.439321 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c8615b1a-10a0-4973-8419-f15eb9c890b3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:26.440101 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c8615b1a-10a0-4973-8419-f15eb9c890b3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:26.440528 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c8615b1a-10a0-4973-8419-f15eb9c890b3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:26.569714 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c8615b1a-10a0-4973-8419-f15eb9c890b3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:26.577099 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c8615b1a-10a0-4973-8419-f15eb9c890b3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1265 microversion: 2.1 time: 0.149742 Jun 16 15:09:26.577664 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 582/1162] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:26 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:27.185914 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-9100cfcd-2bbf-47d1-89e7-d571d81c7ea8 req-934cbf18-193c-4016-8055-9b4c92e67310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd1b913-1070-4e9f-a177-05eeeb807618", "name": "network-vif-plugged", "status": "completed", "tag": "6aa09cb0-494a-49a8-9404-dde31f6924e0"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:09:27.193922 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-9100cfcd-2bbf-47d1-89e7-d571d81c7ea8 req-934cbf18-193c-4016-8055-9b4c92e67310 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:27.194368 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-9100cfcd-2bbf-47d1-89e7-d571d81c7ea8 req-934cbf18-193c-4016-8055-9b4c92e67310 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:27.205009 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-9100cfcd-2bbf-47d1-89e7-d571d81c7ea8 req-934cbf18-193c-4016-8055-9b4c92e67310 service nova] Creating event network-vif-plugged:6aa09cb0-494a-49a8-9404-dde31f6924e0 for instance edd1b913-1070-4e9f-a177-05eeeb807618 on hv-cinder-83716 Jun 16 15:09:27.210087 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-9100cfcd-2bbf-47d1-89e7-d571d81c7ea8 req-934cbf18-193c-4016-8055-9b4c92e67310 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113508 Jun 16 15:09:27.210666 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 581/1163] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:27.594126 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-edce9ffb-9627-4abd-b0f7-91b41accbede tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:27.594730 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-edce9ffb-9627-4abd-b0f7-91b41accbede tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:27.601235 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-edce9ffb-9627-4abd-b0f7-91b41accbede tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:27.601683 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-edce9ffb-9627-4abd-b0f7-91b41accbede tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:27.602437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-edce9ffb-9627-4abd-b0f7-91b41accbede tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:27.602868 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-edce9ffb-9627-4abd-b0f7-91b41accbede tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:27.734196 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-edce9ffb-9627-4abd-b0f7-91b41accbede tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:27.741596 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-edce9ffb-9627-4abd-b0f7-91b41accbede tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1265 microversion: 2.1 time: 0.151335 Jun 16 15:09:27.742148 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 583/1164] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:27 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:28.759234 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3b660423-f134-4e32-ad15-08517413db31 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:28.759958 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3b660423-f134-4e32-ad15-08517413db31 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:28.766717 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3b660423-f134-4e32-ad15-08517413db31 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:28.767169 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3b660423-f134-4e32-ad15-08517413db31 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:28.767957 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3b660423-f134-4e32-ad15-08517413db31 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:28.768398 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3b660423-f134-4e32-ad15-08517413db31 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:28.901750 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3b660423-f134-4e32-ad15-08517413db31 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:28.909366 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3b660423-f134-4e32-ad15-08517413db31 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1452 microversion: 2.1 time: 0.154847 Jun 16 15:09:28.909933 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 582/1165] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:28 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:28.925437 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-00195f6b-822c-4eed-a744-6e3890d0e380 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:28.925997 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-00195f6b-822c-4eed-a744-6e3890d0e380 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:28.932976 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-00195f6b-822c-4eed-a744-6e3890d0e380 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:28.933501 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-00195f6b-822c-4eed-a744-6e3890d0e380 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:28.934368 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-00195f6b-822c-4eed-a744-6e3890d0e380 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:28.934850 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-00195f6b-822c-4eed-a744-6e3890d0e380 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:29.066278 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-00195f6b-822c-4eed-a744-6e3890d0e380 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:29.074379 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-00195f6b-822c-4eed-a744-6e3890d0e380 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1452 microversion: 2.1 time: 0.152794 Jun 16 15:09:29.074939 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 584/1166] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:28 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:30.734901 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-3d2b552f-131a-44e5-afee-18060160c655 req-226fbd77-b9d1-4589-88f8-6a419d776abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edd1b913-1070-4e9f-a177-05eeeb807618", "tag": "6aa09cb0-494a-49a8-9404-dde31f6924e0"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:09:30.742891 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-3d2b552f-131a-44e5-afee-18060160c655 req-226fbd77-b9d1-4589-88f8-6a419d776abf service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:30.743334 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-3d2b552f-131a-44e5-afee-18060160c655 req-226fbd77-b9d1-4589-88f8-6a419d776abf service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:30.754269 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-3d2b552f-131a-44e5-afee-18060160c655 req-226fbd77-b9d1-4589-88f8-6a419d776abf service nova] Creating event network-changed:6aa09cb0-494a-49a8-9404-dde31f6924e0 for instance edd1b913-1070-4e9f-a177-05eeeb807618 on hv-cinder-83716 Jun 16 15:09:30.759286 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-3d2b552f-131a-44e5-afee-18060160c655 req-226fbd77-b9d1-4589-88f8-6a419d776abf service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086519 Jun 16 15:09:30.760461 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 583/1167] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:10:43.749610 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:10:43.750217 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Thu Jun 16 15:10:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:10:52.853920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jun 16 15:10:52.854564 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Thu Jun 16 15:10:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:11:28.037746 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3d399926-472f-4b87-b652-f8ff7332911f] AMQP server on 10.222.0.76:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 16 15:11:28.038488 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=26 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:28.039233 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=54 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:28.044413 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-af14770b-d084-4f46-bef5-0a2ddc72e13b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:28.044905 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-af14770b-d084-4f46-bef5-0a2ddc72e13b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:28.051638 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-af14770b-d084-4f46-bef5-0a2ddc72e13b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:28.052115 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-af14770b-d084-4f46-bef5-0a2ddc72e13b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:28.052874 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-af14770b-d084-4f46-bef5-0a2ddc72e13b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:28.053308 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-af14770b-d084-4f46-bef5-0a2ddc72e13b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:28.077849 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-af14770b-d084-4f46-bef5-0a2ddc72e13b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Going to try to terminate instance {{(pid=117443) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:11:28.153472 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-af14770b-d084-4f46-bef5-0a2ddc72e13b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "DELETE /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 204 len: 0 microversion: 2.1 time: 0.117436 Jun 16 15:11:28.154087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 585/1168] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:11:28 2022] DELETE /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:11:28.160804 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6a6992e6-b31e-4e49-930f-f6fc2ad1d7e9] AMQP server on 10.222.0.76:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 16 15:11:28.161465 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:28.162151 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=44 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:28.166758 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-38fbfde4-8167-4f47-bfd7-bcac53989410 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:28.167479 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-38fbfde4-8167-4f47-bfd7-bcac53989410 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:28.174646 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-38fbfde4-8167-4f47-bfd7-bcac53989410 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:28.175095 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-38fbfde4-8167-4f47-bfd7-bcac53989410 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:28.175897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-38fbfde4-8167-4f47-bfd7-bcac53989410 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:28.176336 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-38fbfde4-8167-4f47-bfd7-bcac53989410 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:28.360864 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-38fbfde4-8167-4f47-bfd7-bcac53989410 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:28.368444 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-38fbfde4-8167-4f47-bfd7-bcac53989410 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1577 microversion: 2.1 time: 0.209465 Jun 16 15:11:28.368993 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 584/1169] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:28 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1577 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:29.386536 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-09901424-5463-4109-9bb7-1bbc5f6a8a09 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:29.387316 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-09901424-5463-4109-9bb7-1bbc5f6a8a09 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:29.397191 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-09901424-5463-4109-9bb7-1bbc5f6a8a09 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:29.397639 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-09901424-5463-4109-9bb7-1bbc5f6a8a09 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:29.398403 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-09901424-5463-4109-9bb7-1bbc5f6a8a09 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:29.398836 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-09901424-5463-4109-9bb7-1bbc5f6a8a09 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:29.406669 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO oslo.messaging._drivers.impl_rabbit [-] [3d399926-472f-4b87-b652-f8ff7332911f] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 39502. Jun 16 15:11:29.584585 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-09901424-5463-4109-9bb7-1bbc5f6a8a09 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:29.592740 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-09901424-5463-4109-9bb7-1bbc5f6a8a09 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1577 microversion: 2.1 time: 0.209746 Jun 16 15:11:29.593299 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 586/1170] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:29 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1577 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:30.610343 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-eb552c33-c9e0-47f9-9913-9204cf52883f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:30.610882 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-eb552c33-c9e0-47f9-9913-9204cf52883f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:30.618505 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-eb552c33-c9e0-47f9-9913-9204cf52883f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:30.618952 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-eb552c33-c9e0-47f9-9913-9204cf52883f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:30.619735 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-eb552c33-c9e0-47f9-9913-9204cf52883f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:30.620170 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-eb552c33-c9e0-47f9-9913-9204cf52883f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:30.642821 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO oslo.messaging._drivers.impl_rabbit [-] [6a6992e6-b31e-4e49-930f-f6fc2ad1d7e9] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 39508. Jun 16 15:11:30.692255 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-142e6ffd-92ea-4310-815d-35f087250930 req-1e696fa5-3219-46d1-be81-18ed83edd5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd1b913-1070-4e9f-a177-05eeeb807618", "name": "network-vif-deleted", "tag": "6aa09cb0-494a-49a8-9404-dde31f6924e0"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:11:30.702008 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-142e6ffd-92ea-4310-815d-35f087250930 req-1e696fa5-3219-46d1-be81-18ed83edd5c1 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:30.702744 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-142e6ffd-92ea-4310-815d-35f087250930 req-1e696fa5-3219-46d1-be81-18ed83edd5c1 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:30.714548 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-142e6ffd-92ea-4310-815d-35f087250930 req-1e696fa5-3219-46d1-be81-18ed83edd5c1 service nova] Creating event network-vif-deleted:6aa09cb0-494a-49a8-9404-dde31f6924e0 for instance edd1b913-1070-4e9f-a177-05eeeb807618 on hv-cinder-83716 Jun 16 15:11:30.719658 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-142e6ffd-92ea-4310-815d-35f087250930 req-1e696fa5-3219-46d1-be81-18ed83edd5c1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031984 Jun 16 15:11:30.721249 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 587/1171] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:11:30.728337 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-eb552c33-c9e0-47f9-9913-9204cf52883f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:30.736912 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-eb552c33-c9e0-47f9-9913-9204cf52883f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 200 len: 1510 microversion: 2.1 time: 0.131043 Jun 16 15:11:30.737481 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 585/1172] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:30 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 1510 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:31.755423 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-aca77d50-5cfb-49a5-8b8a-d9dbd854810e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:31.756261 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-aca77d50-5cfb-49a5-8b8a-d9dbd854810e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:31.763157 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aca77d50-5cfb-49a5-8b8a-d9dbd854810e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:31.763604 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aca77d50-5cfb-49a5-8b8a-d9dbd854810e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:31.764399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aca77d50-5cfb-49a5-8b8a-d9dbd854810e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:31.764835 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-aca77d50-5cfb-49a5-8b8a-d9dbd854810e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:31.779790 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-aca77d50-5cfb-49a5-8b8a-d9dbd854810e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] HTTP exception thrown: Instance edd1b913-1070-4e9f-a177-05eeeb807618 could not be found. Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-aca77d50-5cfb-49a5-8b8a-d9dbd854810e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Request method failure captured: Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 HTTP/1.1 Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0d-q-5-TL-9SZg9InSEub5tli6waA0S2qHpqkjykIPJSjA451tGqmuylDI0sgc8jnSzd69A-VfCZfJqElWuKS9QYsJqzsKQlVCjMfQimD9JJkV_rfvvKskdm9bpIYllf0zmJEwyR5d_mXNltggb-DsfFHwE1Ge45cw_SYhwy_z44sY Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 52a575aa707340efb2cf89faf6a016bc Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-TestVolumeBootPattern-1276089102 Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 15:11:31.781652 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 15:11:31.783214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:11:31.783214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-TestVolumeBootPattern-1276089102 Jun 16 15:11:31.783214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 52a575aa707340efb2cf89faf6a016bc Jun 16 15:11:31.783214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-TestVolumeBootPattern-1276089102 Jun 16 15:11:31.783214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-TestVolumeBootPattern-1276089102-project Jun 16 15:11:31.783214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 15:11:31.783214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 15:11:31.783214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: ee7a7cad42794792b05393a4b1582bc6 Jun 16 15:11:31.783214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-TestVolumeBootPattern-1276089102-project Jun 16 15:11:31.783214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 15:11:31.783214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance edd1b913-1070-4e9f-a177-05eeeb807618 could not be found. Jun 16 15:11:31.783214 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': 'edd1b913-1070-4e9f-a177-05eeeb807618'} Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edd1b913-1070-4e9f-a177-05eeeb807618 could not be found. Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:11:31.784086 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:11:31.785883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:11:31.785883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:11:31.785883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:11:31.785883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:11:31.785883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:11:31.785883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:11:31.785883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:11:31.785883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edd1b913-1070-4e9f-a177-05eeeb807618 could not be found. Jun 16 15:11:31.785883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:11:31.785883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:11:31.785883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:11:31.785883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:11:31.785883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:11:31.785883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:11:31.785883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:11:31.785883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:11:31.785883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edd1b913-1070-4e9f-a177-05eeeb807618 could not be found. Jun 16 15:11:31.785883 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:11:31.787404 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-aca77d50-5cfb-49a5-8b8a-d9dbd854810e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Returning 404 to user: Instance edd1b913-1070-4e9f-a177-05eeeb807618 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:11:31.787404 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-aca77d50-5cfb-49a5-8b8a-d9dbd854810e tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 404 len: 111 microversion: 2.1 time: 0.032019 Jun 16 15:11:31.787404 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 588/1173] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:31 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:11:31.833493 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2afa9b3b-8776-46e3-9150-b3e03a05e025 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1734408329", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1475024670", "security_groups": [{"name": "tempest-secgroup-smoke-324105474"}], "block_device_mapping_v2": [{"uuid": "1603a838-f426-4c07-ad99-bbc68946ac93", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e3e15102-1b6a-4468-bb13-36ba3b3e3528"}]}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:11:31.944346 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-2afa9b3b-8776-46e3-9150-b3e03a05e025 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] validate_networks() for [('e3e15102-1b6a-4468-bb13-36ba3b3e3528', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:11:32.569724 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-2afa9b3b-8776-46e3-9150-b3e03a05e025 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:11:32.570148 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-2afa9b3b-8776-46e3-9150-b3e03a05e025 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:11:32.570621 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-2afa9b3b-8776-46e3-9150-b3e03a05e025 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:11:32.571160 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-2afa9b3b-8776-46e3-9150-b3e03a05e025 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:11:32.571573 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-2afa9b3b-8776-46e3-9150-b3e03a05e025 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:11:32.581000 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2afa9b3b-8776-46e3-9150-b3e03a05e025 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:32.581444 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2afa9b3b-8776-46e3-9150-b3e03a05e025 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:32.582230 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2afa9b3b-8776-46e3-9150-b3e03a05e025 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:32.582663 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2afa9b3b-8776-46e3-9150-b3e03a05e025 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:32.600050 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-2afa9b3b-8776-46e3-9150-b3e03a05e025 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Getting quotas for project 52a575aa707340efb2cf89faf6a016bc. Resources: {'ram', 'cores', 'instances'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:11:32.603851 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-2afa9b3b-8776-46e3-9150-b3e03a05e025 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Getting quotas for user ee7a7cad42794792b05393a4b1582bc6 and project 52a575aa707340efb2cf89faf6a016bc. Resources: {'ram', 'cores', 'instances'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:11:32.659606 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2afa9b3b-8776-46e3-9150-b3e03a05e025 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:11:32.661746 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2afa9b3b-8776-46e3-9150-b3e03a05e025 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1603a838-f426-4c07-ad99-bbc68946ac93',volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:11:32.785211 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2afa9b3b-8776-46e3-9150-b3e03a05e025 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.955542 Jun 16 15:11:32.785859 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 586/1174] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 15:11:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 15:11:32.796196 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ce20921c-b367-4f57-a910-080f18efe911 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:32.796803 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ce20921c-b367-4f57-a910-080f18efe911 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:32.852155 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ce20921c-b367-4f57-a910-080f18efe911 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:32.859202 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ce20921c-b367-4f57-a910-080f18efe911 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 200 len: 1095 microversion: 2.1 time: 0.066751 Jun 16 15:11:32.859867 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 589/1175] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:32 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:33.877467 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-56558097-2a25-4ceb-a404-24d0b8aef51d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:33.878245 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-56558097-2a25-4ceb-a404-24d0b8aef51d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:33.885194 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-56558097-2a25-4ceb-a404-24d0b8aef51d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:33.885646 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-56558097-2a25-4ceb-a404-24d0b8aef51d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:33.886417 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-56558097-2a25-4ceb-a404-24d0b8aef51d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:33.886861 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-56558097-2a25-4ceb-a404-24d0b8aef51d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:33.957377 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-56558097-2a25-4ceb-a404-24d0b8aef51d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:33.964800 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-56558097-2a25-4ceb-a404-24d0b8aef51d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 200 len: 1211 microversion: 2.1 time: 0.092388 Jun 16 15:11:33.966750 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 587/1176] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:33 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:34.982046 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-16288ac6-c6c3-4b0c-8eff-6200473cab99 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:34.982658 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-16288ac6-c6c3-4b0c-8eff-6200473cab99 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:34.992107 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-16288ac6-c6c3-4b0c-8eff-6200473cab99 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:34.992558 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-16288ac6-c6c3-4b0c-8eff-6200473cab99 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:34.993329 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-16288ac6-c6c3-4b0c-8eff-6200473cab99 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:34.993766 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-16288ac6-c6c3-4b0c-8eff-6200473cab99 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:35.221535 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-16288ac6-c6c3-4b0c-8eff-6200473cab99 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:35.230013 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-16288ac6-c6c3-4b0c-8eff-6200473cab99 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 200 len: 1266 microversion: 2.1 time: 0.251804 Jun 16 15:11:35.230700 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 590/1177] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:34 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:35.434326 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-65027df4-5594-4183-a1c9-5a79916b9f6a req-30da1773-6a5e-4ad2-8eb7-9cec2f259a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f06ba9-bccb-4e42-a282-fc1e5eba46b7", "tag": "d76982de-8b32-44b6-858b-8f1bb582cdbe"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:11:35.442769 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-65027df4-5594-4183-a1c9-5a79916b9f6a req-30da1773-6a5e-4ad2-8eb7-9cec2f259a40 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:35.443217 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-65027df4-5594-4183-a1c9-5a79916b9f6a req-30da1773-6a5e-4ad2-8eb7-9cec2f259a40 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:35.455719 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-65027df4-5594-4183-a1c9-5a79916b9f6a req-30da1773-6a5e-4ad2-8eb7-9cec2f259a40 service nova] Creating event network-changed:d76982de-8b32-44b6-858b-8f1bb582cdbe for instance 47f06ba9-bccb-4e42-a282-fc1e5eba46b7 on hv-cinder-83716 Jun 16 15:11:35.461292 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-65027df4-5594-4183-a1c9-5a79916b9f6a req-30da1773-6a5e-4ad2-8eb7-9cec2f259a40 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099258 Jun 16 15:11:35.461887 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 588/1178] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:11:36.246264 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-53e4621a-f773-453a-af24-17fd635acafc tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:36.246897 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-53e4621a-f773-453a-af24-17fd635acafc tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:36.253951 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-53e4621a-f773-453a-af24-17fd635acafc tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:36.254394 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-53e4621a-f773-453a-af24-17fd635acafc tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:36.255157 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-53e4621a-f773-453a-af24-17fd635acafc tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:36.255588 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-53e4621a-f773-453a-af24-17fd635acafc tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:36.472421 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-53e4621a-f773-453a-af24-17fd635acafc tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:36.480001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-53e4621a-f773-453a-af24-17fd635acafc tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 200 len: 1266 microversion: 2.1 time: 0.237528 Jun 16 15:11:36.480573 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 591/1179] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:36 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:37.497918 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3f9cb456-4162-4a49-89a8-3b4803f117ac tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:37.498608 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3f9cb456-4162-4a49-89a8-3b4803f117ac tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:37.505811 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3f9cb456-4162-4a49-89a8-3b4803f117ac tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:37.506339 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3f9cb456-4162-4a49-89a8-3b4803f117ac tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:37.507094 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3f9cb456-4162-4a49-89a8-3b4803f117ac tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:37.507529 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3f9cb456-4162-4a49-89a8-3b4803f117ac tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:37.639137 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3f9cb456-4162-4a49-89a8-3b4803f117ac tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:37.646573 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3f9cb456-4162-4a49-89a8-3b4803f117ac tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 200 len: 1266 microversion: 2.1 time: 0.152902 Jun 16 15:11:37.647122 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 589/1180] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:37 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:38.663339 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-d5f1128a-07b6-4f50-bb06-85262040d768 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:38.664096 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-d5f1128a-07b6-4f50-bb06-85262040d768 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:38.671201 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d5f1128a-07b6-4f50-bb06-85262040d768 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:38.671649 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d5f1128a-07b6-4f50-bb06-85262040d768 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:38.672473 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d5f1128a-07b6-4f50-bb06-85262040d768 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:38.672914 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-d5f1128a-07b6-4f50-bb06-85262040d768 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:38.801111 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-d5f1128a-07b6-4f50-bb06-85262040d768 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:38.808561 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-d5f1128a-07b6-4f50-bb06-85262040d768 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 200 len: 1266 microversion: 2.1 time: 0.149082 Jun 16 15:11:38.809114 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 592/1181] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:38 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:39.825127 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-314f4560-1731-4fff-adbf-a5d7e6116d9a tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:39.825742 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-314f4560-1731-4fff-adbf-a5d7e6116d9a tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:39.832848 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-314f4560-1731-4fff-adbf-a5d7e6116d9a tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:39.833297 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-314f4560-1731-4fff-adbf-a5d7e6116d9a tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:39.834063 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-314f4560-1731-4fff-adbf-a5d7e6116d9a tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:39.834495 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-314f4560-1731-4fff-adbf-a5d7e6116d9a tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:39.962370 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-314f4560-1731-4fff-adbf-a5d7e6116d9a tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:39.969858 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-314f4560-1731-4fff-adbf-a5d7e6116d9a tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 200 len: 1266 microversion: 2.1 time: 0.148598 Jun 16 15:11:39.971025 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 590/1182] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:39 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:40.988826 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8e5fd151-1942-4e53-9e36-75b2dae10c20 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:40.989814 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-8e5fd151-1942-4e53-9e36-75b2dae10c20 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:40.995594 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8e5fd151-1942-4e53-9e36-75b2dae10c20 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:40.996065 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8e5fd151-1942-4e53-9e36-75b2dae10c20 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:40.996813 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8e5fd151-1942-4e53-9e36-75b2dae10c20 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:40.997257 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8e5fd151-1942-4e53-9e36-75b2dae10c20 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:41.134384 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-8e5fd151-1942-4e53-9e36-75b2dae10c20 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:41.141760 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8e5fd151-1942-4e53-9e36-75b2dae10c20 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 200 len: 1266 microversion: 2.1 time: 0.158279 Jun 16 15:11:41.142375 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 593/1183] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:40 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:42.159189 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-36561385-9bf4-4127-ab8f-fb0c039504cd tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:42.159811 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-36561385-9bf4-4127-ab8f-fb0c039504cd tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:42.166706 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-36561385-9bf4-4127-ab8f-fb0c039504cd tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:42.167152 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-36561385-9bf4-4127-ab8f-fb0c039504cd tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:42.167931 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-36561385-9bf4-4127-ab8f-fb0c039504cd tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:42.168505 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-36561385-9bf4-4127-ab8f-fb0c039504cd tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:42.302552 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-36561385-9bf4-4127-ab8f-fb0c039504cd tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:42.310138 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-36561385-9bf4-4127-ab8f-fb0c039504cd tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 200 len: 1266 microversion: 2.1 time: 0.155546 Jun 16 15:11:42.310689 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 591/1184] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:42 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:43.327854 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c6675809-1813-415e-abe0-a8a11262c508 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:43.328452 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c6675809-1813-415e-abe0-a8a11262c508 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:43.330786 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=2 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:43.336721 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c6675809-1813-415e-abe0-a8a11262c508 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:43.337158 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c6675809-1813-415e-abe0-a8a11262c508 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:43.337902 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c6675809-1813-415e-abe0-a8a11262c508 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:43.338325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c6675809-1813-415e-abe0-a8a11262c508 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:43.468865 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c6675809-1813-415e-abe0-a8a11262c508 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:43.476507 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c6675809-1813-415e-abe0-a8a11262c508 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 200 len: 1266 microversion: 2.1 time: 0.152493 Jun 16 15:11:43.477057 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 594/1185] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:43 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:44.492310 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4f70d3a3-8c92-4526-801e-78a723e4dca5 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:44.492925 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4f70d3a3-8c92-4526-801e-78a723e4dca5 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:44.495079 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:44.495762 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=6 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:44.502106 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4f70d3a3-8c92-4526-801e-78a723e4dca5 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:44.502558 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4f70d3a3-8c92-4526-801e-78a723e4dca5 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:44.503332 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4f70d3a3-8c92-4526-801e-78a723e4dca5 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:44.503798 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4f70d3a3-8c92-4526-801e-78a723e4dca5 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:44.637727 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4f70d3a3-8c92-4526-801e-78a723e4dca5 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:44.645722 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4f70d3a3-8c92-4526-801e-78a723e4dca5 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 200 len: 1266 microversion: 2.1 time: 0.157476 Jun 16 15:11:44.646279 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 592/1186] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:44 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:45.663027 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c3f04756-aa1a-4d6b-9fb3-401dd6e8dd18 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:45.663646 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c3f04756-aa1a-4d6b-9fb3-401dd6e8dd18 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:45.670912 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c3f04756-aa1a-4d6b-9fb3-401dd6e8dd18 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:45.671452 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c3f04756-aa1a-4d6b-9fb3-401dd6e8dd18 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:45.672347 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c3f04756-aa1a-4d6b-9fb3-401dd6e8dd18 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:45.672784 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c3f04756-aa1a-4d6b-9fb3-401dd6e8dd18 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:45.742378 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-c5930841-6a8e-4c9c-b1d2-363b10b7c01d req-a27f6824-0a91-4171-9d72-870d803de537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f06ba9-bccb-4e42-a282-fc1e5eba46b7", "name": "network-vif-plugged", "status": "completed", "tag": "d76982de-8b32-44b6-858b-8f1bb582cdbe"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:11:45.753956 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-c5930841-6a8e-4c9c-b1d2-363b10b7c01d req-a27f6824-0a91-4171-9d72-870d803de537 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:45.754506 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-c5930841-6a8e-4c9c-b1d2-363b10b7c01d req-a27f6824-0a91-4171-9d72-870d803de537 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:45.766441 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-c5930841-6a8e-4c9c-b1d2-363b10b7c01d req-a27f6824-0a91-4171-9d72-870d803de537 service nova] Creating event network-vif-plugged:d76982de-8b32-44b6-858b-8f1bb582cdbe for instance 47f06ba9-bccb-4e42-a282-fc1e5eba46b7 on hv-cinder-83716 Jun 16 15:11:45.772939 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-c5930841-6a8e-4c9c-b1d2-363b10b7c01d req-a27f6824-0a91-4171-9d72-870d803de537 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034466 Jun 16 15:11:45.773735 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 593/1187] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:11:45.826428 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c3f04756-aa1a-4d6b-9fb3-401dd6e8dd18 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:45.834716 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c3f04756-aa1a-4d6b-9fb3-401dd6e8dd18 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 200 len: 1266 microversion: 2.1 time: 0.176113 Jun 16 15:11:45.835284 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 595/1188] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:45 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:46.852815 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b863d8fa-82f5-4a62-95e6-433186e5f563 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:46.853507 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b863d8fa-82f5-4a62-95e6-433186e5f563 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:46.859702 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b863d8fa-82f5-4a62-95e6-433186e5f563 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:46.860165 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b863d8fa-82f5-4a62-95e6-433186e5f563 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:46.860926 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b863d8fa-82f5-4a62-95e6-433186e5f563 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:46.861363 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b863d8fa-82f5-4a62-95e6-433186e5f563 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:46.996334 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b863d8fa-82f5-4a62-95e6-433186e5f563 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:47.003873 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b863d8fa-82f5-4a62-95e6-433186e5f563 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 200 len: 1266 microversion: 2.1 time: 0.156233 Jun 16 15:11:47.004436 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 594/1189] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:46 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:48.020163 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1bfa5057-a620-4d5c-8d28-d8e3da199142 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:48.020684 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-1bfa5057-a620-4d5c-8d28-d8e3da199142 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:48.027209 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1bfa5057-a620-4d5c-8d28-d8e3da199142 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:48.027653 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1bfa5057-a620-4d5c-8d28-d8e3da199142 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:48.028430 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1bfa5057-a620-4d5c-8d28-d8e3da199142 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:48.028860 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1bfa5057-a620-4d5c-8d28-d8e3da199142 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:48.161967 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1bfa5057-a620-4d5c-8d28-d8e3da199142 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:48.170306 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1bfa5057-a620-4d5c-8d28-d8e3da199142 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 200 len: 1453 microversion: 2.1 time: 0.154088 Jun 16 15:11:48.170866 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 596/1190] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:48 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:48.187167 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-49949d62-272a-49c1-ae02-6d669b4d8ff2 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:48.187812 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-49949d62-272a-49c1-ae02-6d669b4d8ff2 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:48.195056 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-49949d62-272a-49c1-ae02-6d669b4d8ff2 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:48.195508 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-49949d62-272a-49c1-ae02-6d669b4d8ff2 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:48.196298 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-49949d62-272a-49c1-ae02-6d669b4d8ff2 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:48.196745 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-49949d62-272a-49c1-ae02-6d669b4d8ff2 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:48.323664 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-49949d62-272a-49c1-ae02-6d669b4d8ff2 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:48.331222 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-49949d62-272a-49c1-ae02-6d669b4d8ff2 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 200 len: 1453 microversion: 2.1 time: 0.147992 Jun 16 15:11:48.331812 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 595/1191] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:48 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:11:50.138091 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-f587c6ab-7ab1-43b6-b03a-71fc8f67fbe9 req-32c10141-580e-46e6-971f-c17006e381e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f06ba9-bccb-4e42-a282-fc1e5eba46b7", "tag": "d76982de-8b32-44b6-858b-8f1bb582cdbe"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:11:50.146319 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-f587c6ab-7ab1-43b6-b03a-71fc8f67fbe9 req-32c10141-580e-46e6-971f-c17006e381e3 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:50.146808 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-f587c6ab-7ab1-43b6-b03a-71fc8f67fbe9 req-32c10141-580e-46e6-971f-c17006e381e3 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:50.159233 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-f587c6ab-7ab1-43b6-b03a-71fc8f67fbe9 req-32c10141-580e-46e6-971f-c17006e381e3 service nova] Creating event network-changed:d76982de-8b32-44b6-858b-8f1bb582cdbe for instance 47f06ba9-bccb-4e42-a282-fc1e5eba46b7 on hv-cinder-83716 Jun 16 15:11:50.165184 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-f587c6ab-7ab1-43b6-b03a-71fc8f67fbe9 req-32c10141-580e-46e6-971f-c17006e381e3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030631 Jun 16 15:11:50.166045 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 597/1192] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:12:32.455916 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:12:32.456657 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Thu Jun 16 15:12:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:13:25.303089 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:25.303841 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=60 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:25.307841 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c0825ec9-cedd-43db-ba40-304a6face2df tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-104913601", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1475024670", "security_groups": [{"name": "tempest-secgroup-smoke-324105474"}], "block_device_mapping_v2": [{"uuid": "b0f8fdb7-a6a8-4c83-b73b-358c25672bc3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e3e15102-1b6a-4468-bb13-36ba3b3e3528"}]}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:13:25.415669 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-c0825ec9-cedd-43db-ba40-304a6face2df tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] validate_networks() for [('e3e15102-1b6a-4468-bb13-36ba3b3e3528', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:13:25.781611 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-c0825ec9-cedd-43db-ba40-304a6face2df tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:13:25.782039 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-c0825ec9-cedd-43db-ba40-304a6face2df tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:13:25.782513 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-c0825ec9-cedd-43db-ba40-304a6face2df tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:13:25.782941 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-c0825ec9-cedd-43db-ba40-304a6face2df tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:13:25.783358 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-c0825ec9-cedd-43db-ba40-304a6face2df tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:13:25.792373 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c0825ec9-cedd-43db-ba40-304a6face2df tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:25.792822 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c0825ec9-cedd-43db-ba40-304a6face2df tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:25.793613 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c0825ec9-cedd-43db-ba40-304a6face2df tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:25.794045 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c0825ec9-cedd-43db-ba40-304a6face2df tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:25.811126 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-c0825ec9-cedd-43db-ba40-304a6face2df tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Getting quotas for project 52a575aa707340efb2cf89faf6a016bc. Resources: {'ram', 'cores', 'instances'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:13:25.815077 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-c0825ec9-cedd-43db-ba40-304a6face2df tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Getting quotas for user ee7a7cad42794792b05393a4b1582bc6 and project 52a575aa707340efb2cf89faf6a016bc. Resources: {'ram', 'cores', 'instances'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:13:25.870956 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c0825ec9-cedd-43db-ba40-304a6face2df tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:13:25.873107 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c0825ec9-cedd-43db-ba40-304a6face2df tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b0f8fdb7-a6a8-4c83-b73b-358c25672bc3',volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:13:25.998659 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c0825ec9-cedd-43db-ba40-304a6face2df tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.697079 Jun 16 15:13:25.999757 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 596/1193] 10.222.0.76 () {60 vars in 1146 bytes} [Thu Jun 16 15:13:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 15:13:26.009042 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:26.009778 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:26.014943 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-fb827e14-096d-4d4f-9c6b-df8beeb4e7f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:26.015660 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-fb827e14-096d-4d4f-9c6b-df8beeb4e7f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:26.070738 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-fb827e14-096d-4d4f-9c6b-df8beeb4e7f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:26.077897 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-fb827e14-096d-4d4f-9c6b-df8beeb4e7f0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1094 microversion: 2.1 time: 0.070995 Jun 16 15:13:26.078441 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 598/1194] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:26 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:27.094837 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ded90673-358e-4575-8ac8-09119db7805c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:27.095450 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ded90673-358e-4575-8ac8-09119db7805c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:27.148997 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ded90673-358e-4575-8ac8-09119db7805c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:27.155895 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ded90673-358e-4575-8ac8-09119db7805c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1094 microversion: 2.1 time: 0.065491 Jun 16 15:13:27.156479 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 597/1195] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:27 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:28.172592 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-ff30ea7c-be08-45e6-9a2b-d3b784a93bcb tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:28.173284 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-ff30ea7c-be08-45e6-9a2b-d3b784a93bcb tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:28.229283 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-ff30ea7c-be08-45e6-9a2b-d3b784a93bcb tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:28.237190 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-ff30ea7c-be08-45e6-9a2b-d3b784a93bcb tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1094 microversion: 2.1 time: 0.068829 Jun 16 15:13:28.237749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 599/1196] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:28 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:29.254125 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0946ab8b-1b7a-4296-b474-7c7fcaba6777 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:29.254731 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0946ab8b-1b7a-4296-b474-7c7fcaba6777 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:29.307406 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0946ab8b-1b7a-4296-b474-7c7fcaba6777 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:29.314145 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0946ab8b-1b7a-4296-b474-7c7fcaba6777 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1094 microversion: 2.1 time: 0.063925 Jun 16 15:13:29.314698 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 598/1197] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:29 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:30.331616 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-c35a3d31-75d5-4fa6-96e3-1317ce402d84 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:30.332256 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-c35a3d31-75d5-4fa6-96e3-1317ce402d84 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:30.338495 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c35a3d31-75d5-4fa6-96e3-1317ce402d84 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:30.338948 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c35a3d31-75d5-4fa6-96e3-1317ce402d84 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:30.339733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c35a3d31-75d5-4fa6-96e3-1317ce402d84 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:30.340172 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-c35a3d31-75d5-4fa6-96e3-1317ce402d84 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:30.398855 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-c35a3d31-75d5-4fa6-96e3-1317ce402d84 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:30.406810 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-c35a3d31-75d5-4fa6-96e3-1317ce402d84 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1144 microversion: 2.1 time: 0.079239 Jun 16 15:13:30.407373 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 600/1198] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:30 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:31.423357 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4d8f8109-ffb5-4d4c-acc1-5b44c09e947d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:31.424001 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4d8f8109-ffb5-4d4c-acc1-5b44c09e947d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:31.430895 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4d8f8109-ffb5-4d4c-acc1-5b44c09e947d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:31.431427 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4d8f8109-ffb5-4d4c-acc1-5b44c09e947d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:31.432116 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4d8f8109-ffb5-4d4c-acc1-5b44c09e947d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:31.432580 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4d8f8109-ffb5-4d4c-acc1-5b44c09e947d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:31.513916 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4d8f8109-ffb5-4d4c-acc1-5b44c09e947d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:31.521713 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4d8f8109-ffb5-4d4c-acc1-5b44c09e947d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1210 microversion: 2.1 time: 0.102187 Jun 16 15:13:31.522283 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 599/1199] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:31 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:32.538353 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-4f42b94f-7b92-479c-9fc9-4d9f66beb45c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:32.538956 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-4f42b94f-7b92-479c-9fc9-4d9f66beb45c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:32.546361 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4f42b94f-7b92-479c-9fc9-4d9f66beb45c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:32.546807 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4f42b94f-7b92-479c-9fc9-4d9f66beb45c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:32.547574 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4f42b94f-7b92-479c-9fc9-4d9f66beb45c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:32.548024 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-4f42b94f-7b92-479c-9fc9-4d9f66beb45c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:32.742167 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-4f42b94f-7b92-479c-9fc9-4d9f66beb45c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:32.750350 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-4f42b94f-7b92-479c-9fc9-4d9f66beb45c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1265 microversion: 2.1 time: 0.215827 Jun 16 15:13:32.750919 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 601/1200] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:32 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:32.798651 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-d27a6504-8054-4514-9071-7190147444c5 req-cbb83319-e868-4272-978c-86694fdff13f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e4e353-8f54-4144-a30c-a0f31d8dfa68", "tag": "97fcee57-0099-423b-bd3e-847bff6c0bb8"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:13:32.819047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-d27a6504-8054-4514-9071-7190147444c5 req-cbb83319-e868-4272-978c-86694fdff13f service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:32.819518 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-d27a6504-8054-4514-9071-7190147444c5 req-cbb83319-e868-4272-978c-86694fdff13f service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:32.832661 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-d27a6504-8054-4514-9071-7190147444c5 req-cbb83319-e868-4272-978c-86694fdff13f service nova] Creating event network-changed:97fcee57-0099-423b-bd3e-847bff6c0bb8 for instance d3e4e353-8f54-4144-a30c-a0f31d8dfa68 on hv-cinder-83716 Jun 16 15:13:32.838368 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-d27a6504-8054-4514-9071-7190147444c5 req-cbb83319-e868-4272-978c-86694fdff13f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053498 Jun 16 15:13:32.839313 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 600/1201] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:13:33.768555 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-381682e7-f596-49a3-ad47-3e389151a46c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:33.769175 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-381682e7-f596-49a3-ad47-3e389151a46c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:33.775664 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-381682e7-f596-49a3-ad47-3e389151a46c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:33.776135 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-381682e7-f596-49a3-ad47-3e389151a46c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:33.776913 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-381682e7-f596-49a3-ad47-3e389151a46c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:33.777422 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-381682e7-f596-49a3-ad47-3e389151a46c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:33.988274 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-381682e7-f596-49a3-ad47-3e389151a46c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:33.995646 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-381682e7-f596-49a3-ad47-3e389151a46c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1265 microversion: 2.1 time: 0.231512 Jun 16 15:13:33.996230 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 602/1202] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:33 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:13:35.014684 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-433f33cc-e746-4184-98ac-fae410cd09ac tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:35.015340 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-433f33cc-e746-4184-98ac-fae410cd09ac tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:35.021459 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-433f33cc-e746-4184-98ac-fae410cd09ac tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:35.021897 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-433f33cc-e746-4184-98ac-fae410cd09ac tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:35.022646 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-433f33cc-e746-4184-98ac-fae410cd09ac tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:35.023072 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-433f33cc-e746-4184-98ac-fae410cd09ac tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:35.157725 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-433f33cc-e746-4184-98ac-fae410cd09ac tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:35.165124 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-433f33cc-e746-4184-98ac-fae410cd09ac tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1265 microversion: 2.1 time: 0.155878 Jun 16 15:13:35.165676 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 601/1203] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:35 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:36.181517 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-1b426e04-daaa-4c63-8349-63e955140ec6 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:36.182155 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-1b426e04-daaa-4c63-8349-63e955140ec6 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:36.188602 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1b426e04-daaa-4c63-8349-63e955140ec6 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:36.189046 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1b426e04-daaa-4c63-8349-63e955140ec6 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:36.189782 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1b426e04-daaa-4c63-8349-63e955140ec6 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:36.190205 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-1b426e04-daaa-4c63-8349-63e955140ec6 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:36.318618 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-1b426e04-daaa-4c63-8349-63e955140ec6 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:36.326539 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-1b426e04-daaa-4c63-8349-63e955140ec6 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1265 microversion: 2.1 time: 0.148927 Jun 16 15:13:36.327090 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 603/1204] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:36 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:37.343174 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f2701803-88a7-4ec2-89f7-ef1b35343db0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:37.343796 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f2701803-88a7-4ec2-89f7-ef1b35343db0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:37.345620 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:37.351797 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f2701803-88a7-4ec2-89f7-ef1b35343db0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:37.352250 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f2701803-88a7-4ec2-89f7-ef1b35343db0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:37.353131 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f2701803-88a7-4ec2-89f7-ef1b35343db0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:37.353566 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f2701803-88a7-4ec2-89f7-ef1b35343db0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:37.482349 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f2701803-88a7-4ec2-89f7-ef1b35343db0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:37.489733 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f2701803-88a7-4ec2-89f7-ef1b35343db0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1265 microversion: 2.1 time: 0.150563 Jun 16 15:13:37.490283 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 602/1205] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:37 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:38.507001 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-49cc0ab9-9617-44c4-a869-d87711c9bc98 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:38.507565 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-49cc0ab9-9617-44c4-a869-d87711c9bc98 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:38.509998 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell0:SELECT=4 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:38.515672 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-49cc0ab9-9617-44c4-a869-d87711c9bc98 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:38.516221 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-49cc0ab9-9617-44c4-a869-d87711c9bc98 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:38.516980 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-49cc0ab9-9617-44c4-a869-d87711c9bc98 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:38.517414 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-49cc0ab9-9617-44c4-a869-d87711c9bc98 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:38.650386 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-49cc0ab9-9617-44c4-a869-d87711c9bc98 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:38.657919 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-49cc0ab9-9617-44c4-a869-d87711c9bc98 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1265 microversion: 2.1 time: 0.154895 Jun 16 15:13:38.658483 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 604/1206] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:38 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:39.675222 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3e77df2c-0836-43c6-8445-f918bdaae13b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:39.675860 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3e77df2c-0836-43c6-8445-f918bdaae13b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:39.678115 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=10 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:39.683408 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e77df2c-0836-43c6-8445-f918bdaae13b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:39.683880 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e77df2c-0836-43c6-8445-f918bdaae13b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:39.685151 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e77df2c-0836-43c6-8445-f918bdaae13b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:39.685583 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e77df2c-0836-43c6-8445-f918bdaae13b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:39.814284 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3e77df2c-0836-43c6-8445-f918bdaae13b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:39.821662 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3e77df2c-0836-43c6-8445-f918bdaae13b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1265 microversion: 2.1 time: 0.150373 Jun 16 15:13:39.822216 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 603/1207] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:39 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:40.838285 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-0314c9e6-2ee4-4191-9896-c931966b9415 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:40.839011 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-0314c9e6-2ee4-4191-9896-c931966b9415 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:40.846038 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0314c9e6-2ee4-4191-9896-c931966b9415 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:40.846482 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0314c9e6-2ee4-4191-9896-c931966b9415 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:40.847243 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0314c9e6-2ee4-4191-9896-c931966b9415 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:40.847733 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-0314c9e6-2ee4-4191-9896-c931966b9415 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:40.984765 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-0314c9e6-2ee4-4191-9896-c931966b9415 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:40.992113 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-0314c9e6-2ee4-4191-9896-c931966b9415 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1265 microversion: 2.1 time: 0.157639 Jun 16 15:13:40.992668 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 605/1208] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:40 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:42.010134 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7b039003-3283-49d4-a56a-9021944c7b27 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:42.010712 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7b039003-3283-49d4-a56a-9021944c7b27 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:42.017864 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b039003-3283-49d4-a56a-9021944c7b27 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:42.018314 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b039003-3283-49d4-a56a-9021944c7b27 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:42.019077 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b039003-3283-49d4-a56a-9021944c7b27 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:42.019515 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b039003-3283-49d4-a56a-9021944c7b27 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:42.151807 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7b039003-3283-49d4-a56a-9021944c7b27 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:42.160965 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7b039003-3283-49d4-a56a-9021944c7b27 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1265 microversion: 2.1 time: 0.154140 Jun 16 15:13:42.161911 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 604/1209] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:42 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:42.332611 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-4c532f86-2187-4078-850d-1341199b6830 req-890a70d8-7444-4947-ab5d-7c2e4fbcd1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e4e353-8f54-4144-a30c-a0f31d8dfa68", "name": "network-vif-plugged", "status": "completed", "tag": "97fcee57-0099-423b-bd3e-847bff6c0bb8"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:13:42.342104 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-4c532f86-2187-4078-850d-1341199b6830 req-890a70d8-7444-4947-ab5d-7c2e4fbcd1f3 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:42.342626 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-4c532f86-2187-4078-850d-1341199b6830 req-890a70d8-7444-4947-ab5d-7c2e4fbcd1f3 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:42.354693 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-4c532f86-2187-4078-850d-1341199b6830 req-890a70d8-7444-4947-ab5d-7c2e4fbcd1f3 service nova] Creating event network-vif-plugged:97fcee57-0099-423b-bd3e-847bff6c0bb8 for instance d3e4e353-8f54-4144-a30c-a0f31d8dfa68 on hv-cinder-83716 Jun 16 15:13:42.360450 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-4c532f86-2187-4078-850d-1341199b6830 req-890a70d8-7444-4947-ab5d-7c2e4fbcd1f3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032503 Jun 16 15:13:42.361047 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 606/1210] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:13:43.178694 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8b91651a-78f0-4acb-bb6a-9d5ea81b8c3b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:43.179302 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8b91651a-78f0-4acb-bb6a-9d5ea81b8c3b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:43.186333 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8b91651a-78f0-4acb-bb6a-9d5ea81b8c3b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:43.186779 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8b91651a-78f0-4acb-bb6a-9d5ea81b8c3b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:43.187539 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8b91651a-78f0-4acb-bb6a-9d5ea81b8c3b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:43.188076 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8b91651a-78f0-4acb-bb6a-9d5ea81b8c3b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:43.318222 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8b91651a-78f0-4acb-bb6a-9d5ea81b8c3b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:43.326507 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8b91651a-78f0-4acb-bb6a-9d5ea81b8c3b tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1265 microversion: 2.1 time: 0.151666 Jun 16 15:13:43.327072 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 605/1211] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:43 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:44.344885 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-8d1f79e1-bb8d-4f6f-8d50-8faec0d3cc5d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:44.345912 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-8d1f79e1-bb8d-4f6f-8d50-8faec0d3cc5d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:44.352642 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8d1f79e1-bb8d-4f6f-8d50-8faec0d3cc5d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:44.353093 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8d1f79e1-bb8d-4f6f-8d50-8faec0d3cc5d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:44.353859 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8d1f79e1-bb8d-4f6f-8d50-8faec0d3cc5d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:44.354293 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-8d1f79e1-bb8d-4f6f-8d50-8faec0d3cc5d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:44.484969 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-8d1f79e1-bb8d-4f6f-8d50-8faec0d3cc5d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:44.492603 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-8d1f79e1-bb8d-4f6f-8d50-8faec0d3cc5d tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1451 microversion: 2.1 time: 0.153154 Jun 16 15:13:44.493219 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 607/1212] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:44 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:44.509102 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cb15ce46-5a61-4cd7-a2a7-df8fcb41b205 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:44.509715 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-cb15ce46-5a61-4cd7-a2a7-df8fcb41b205 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:44.516584 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cb15ce46-5a61-4cd7-a2a7-df8fcb41b205 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:44.517032 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cb15ce46-5a61-4cd7-a2a7-df8fcb41b205 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:44.517787 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cb15ce46-5a61-4cd7-a2a7-df8fcb41b205 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:44.518223 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cb15ce46-5a61-4cd7-a2a7-df8fcb41b205 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:44.651356 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cb15ce46-5a61-4cd7-a2a7-df8fcb41b205 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:44.659641 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-cb15ce46-5a61-4cd7-a2a7-df8fcb41b205 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1451 microversion: 2.1 time: 0.154381 Jun 16 15:13:44.660224 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 606/1213] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:44 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:46.214745 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-28739ab4-4330-4f92-97db-135e416d951a req-7b4d0d2c-77ce-4691-8301-78ce7f853cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e4e353-8f54-4144-a30c-a0f31d8dfa68", "tag": "97fcee57-0099-423b-bd3e-847bff6c0bb8"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:13:46.223879 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-28739ab4-4330-4f92-97db-135e416d951a req-7b4d0d2c-77ce-4691-8301-78ce7f853cc3 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:46.224308 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-28739ab4-4330-4f92-97db-135e416d951a req-7b4d0d2c-77ce-4691-8301-78ce7f853cc3 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:46.236145 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-28739ab4-4330-4f92-97db-135e416d951a req-7b4d0d2c-77ce-4691-8301-78ce7f853cc3 service nova] Creating event network-changed:97fcee57-0099-423b-bd3e-847bff6c0bb8 for instance d3e4e353-8f54-4144-a30c-a0f31d8dfa68 on hv-cinder-83716 Jun 16 15:13:46.240997 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-28739ab4-4330-4f92-97db-135e416d951a req-7b4d0d2c-77ce-4691-8301-78ce7f853cc3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029978 Jun 16 15:13:46.241773 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 608/1214] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:14:03.758506 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:14:03.759047 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Thu Jun 16 15:14:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:14:12.862154 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:14:12.862713 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Thu Jun 16 15:14:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:15:29.094071 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:29.095614 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=46 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:29.096824 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_api:SELECT=26 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:29.097712 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG dbcounter [-] [117443] Writing DB stats nova_cell1:SELECT=46 {{(pid=117443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:29.100570 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ccf7875b-e9f3-4bce-98f4-e66dd82155cd tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:15:29.101212 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ccf7875b-e9f3-4bce-98f4-e66dd82155cd tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:15:29.111764 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ccf7875b-e9f3-4bce-98f4-e66dd82155cd tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:29.112739 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ccf7875b-e9f3-4bce-98f4-e66dd82155cd tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:29.114016 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ccf7875b-e9f3-4bce-98f4-e66dd82155cd tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:29.114617 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ccf7875b-e9f3-4bce-98f4-e66dd82155cd tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:29.141545 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ccf7875b-e9f3-4bce-98f4-e66dd82155cd tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:15:29.158181 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-d6ae1db1-2c7d-4a8e-a38f-0d877b7935e9 req-b9170bf1-a37d-4144-8d9e-1eeaba86343a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e4e353-8f54-4144-a30c-a0f31d8dfa68", "tag": "97fcee57-0099-423b-bd3e-847bff6c0bb8"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:15:29.166789 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-d6ae1db1-2c7d-4a8e-a38f-0d877b7935e9 req-b9170bf1-a37d-4144-8d9e-1eeaba86343a service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:29.167248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-d6ae1db1-2c7d-4a8e-a38f-0d877b7935e9 req-b9170bf1-a37d-4144-8d9e-1eeaba86343a service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:29.179486 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-d6ae1db1-2c7d-4a8e-a38f-0d877b7935e9 req-b9170bf1-a37d-4144-8d9e-1eeaba86343a service nova] Creating event network-changed:97fcee57-0099-423b-bd3e-847bff6c0bb8 for instance d3e4e353-8f54-4144-a30c-a0f31d8dfa68 on hv-cinder-83716 Jun 16 15:15:29.186005 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-d6ae1db1-2c7d-4a8e-a38f-0d877b7935e9 req-b9170bf1-a37d-4144-8d9e-1eeaba86343a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091444 Jun 16 15:15:29.186593 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 609/1215] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:15:29.225851 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ccf7875b-e9f3-4bce-98f4-e66dd82155cd tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 204 len: 0 microversion: 2.1 time: 0.133502 Jun 16 15:15:29.227906 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 607/1216] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:15:29 2022] DELETE /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:15:29.241784 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-5bebdbae-d0a2-464b-96ce-c948f38ee6cf tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:15:29.242574 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-5bebdbae-d0a2-464b-96ce-c948f38ee6cf tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:15:29.249341 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5bebdbae-d0a2-464b-96ce-c948f38ee6cf tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:29.250030 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5bebdbae-d0a2-464b-96ce-c948f38ee6cf tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:29.250798 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5bebdbae-d0a2-464b-96ce-c948f38ee6cf tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:29.251413 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-5bebdbae-d0a2-464b-96ce-c948f38ee6cf tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:29.388671 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-5bebdbae-d0a2-464b-96ce-c948f38ee6cf tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:15:29.396395 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-5bebdbae-d0a2-464b-96ce-c948f38ee6cf tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1576 microversion: 2.1 time: 0.159990 Jun 16 15:15:29.396969 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 610/1217] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:15:29 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:15:30.415568 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-85b1fef7-f977-462f-9163-a9884b0f91c0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:15:30.416322 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-85b1fef7-f977-462f-9163-a9884b0f91c0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:15:30.424754 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-85b1fef7-f977-462f-9163-a9884b0f91c0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:30.425202 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-85b1fef7-f977-462f-9163-a9884b0f91c0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:30.425967 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-85b1fef7-f977-462f-9163-a9884b0f91c0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:30.426400 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-85b1fef7-f977-462f-9163-a9884b0f91c0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:30.559595 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-85b1fef7-f977-462f-9163-a9884b0f91c0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:15:30.567124 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-85b1fef7-f977-462f-9163-a9884b0f91c0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1576 microversion: 2.1 time: 0.155831 Jun 16 15:15:30.567703 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 608/1218] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:15:30 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:15:31.435271 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-8d385c81-22c3-466e-a44c-2f8b661adcc5 req-01f0c0b2-daae-4e4a-92a1-0792c6ad761a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e4e353-8f54-4144-a30c-a0f31d8dfa68", "name": "network-vif-deleted", "tag": "97fcee57-0099-423b-bd3e-847bff6c0bb8"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:15:31.444366 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-8d385c81-22c3-466e-a44c-2f8b661adcc5 req-01f0c0b2-daae-4e4a-92a1-0792c6ad761a service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:31.444800 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-8d385c81-22c3-466e-a44c-2f8b661adcc5 req-01f0c0b2-daae-4e4a-92a1-0792c6ad761a service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:31.455877 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-8d385c81-22c3-466e-a44c-2f8b661adcc5 req-01f0c0b2-daae-4e4a-92a1-0792c6ad761a service nova] Creating event network-vif-deleted:97fcee57-0099-423b-bd3e-847bff6c0bb8 for instance d3e4e353-8f54-4144-a30c-a0f31d8dfa68 on hv-cinder-83716 Jun 16 15:15:31.460940 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-8d385c81-22c3-466e-a44c-2f8b661adcc5 req-01f0c0b2-daae-4e4a-92a1-0792c6ad761a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029525 Jun 16 15:15:31.461569 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 611/1219] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:15:31.583953 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7b14fb4d-f37f-405c-a2a3-2ae6de5d46b7 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:15:31.584564 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7b14fb4d-f37f-405c-a2a3-2ae6de5d46b7 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:15:31.590601 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b14fb4d-f37f-405c-a2a3-2ae6de5d46b7 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:31.590984 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b14fb4d-f37f-405c-a2a3-2ae6de5d46b7 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:31.591808 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b14fb4d-f37f-405c-a2a3-2ae6de5d46b7 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:31.592246 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b14fb4d-f37f-405c-a2a3-2ae6de5d46b7 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:31.653190 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7b14fb4d-f37f-405c-a2a3-2ae6de5d46b7 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:15:31.661497 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7b14fb4d-f37f-405c-a2a3-2ae6de5d46b7 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 200 len: 1225 microversion: 2.1 time: 0.081588 Jun 16 15:15:31.662059 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 609/1220] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:15:31 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:15:32.679284 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-9a8fd8e4-d4a0-4177-ae33-ae31dd67a45c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:15:32.679991 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-9a8fd8e4-d4a0-4177-ae33-ae31dd67a45c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: d3e4e353-8f54-4144-a30c-a0f31d8dfa68] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:15:32.686133 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9a8fd8e4-d4a0-4177-ae33-ae31dd67a45c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:32.686576 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9a8fd8e4-d4a0-4177-ae33-ae31dd67a45c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:32.687316 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9a8fd8e4-d4a0-4177-ae33-ae31dd67a45c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:32.687765 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-9a8fd8e4-d4a0-4177-ae33-ae31dd67a45c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:32.700533 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-9a8fd8e4-d4a0-4177-ae33-ae31dd67a45c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] HTTP exception thrown: Instance d3e4e353-8f54-4144-a30c-a0f31d8dfa68 could not be found. Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-9a8fd8e4-d4a0-4177-ae33-ae31dd67a45c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Request method failure captured: Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 HTTP/1.1 Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0d-q-5-TL-9SZg9InSEub5tli6waA0S2qHpqkjykIPJSjA451tGqmuylDI0sgc8jnSzd69A-VfCZfJqElWuKS9QYsJqzsKQlVCjMfQimD9JJkV_rfvvKskdm9bpIYllf0zmJEwyR5d_mXNltggb-DsfFHwE1Ge45cw_SYhwy_z44sY Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 52a575aa707340efb2cf89faf6a016bc Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-TestVolumeBootPattern-1276089102 Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 15:15:32.702087 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 15:15:32.703920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:15:32.703920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-TestVolumeBootPattern-1276089102 Jun 16 15:15:32.703920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 52a575aa707340efb2cf89faf6a016bc Jun 16 15:15:32.703920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-TestVolumeBootPattern-1276089102 Jun 16 15:15:32.703920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-TestVolumeBootPattern-1276089102-project Jun 16 15:15:32.703920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 15:15:32.703920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 15:15:32.703920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: ee7a7cad42794792b05393a4b1582bc6 Jun 16 15:15:32.703920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-TestVolumeBootPattern-1276089102-project Jun 16 15:15:32.703920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 15:15:32.703920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance d3e4e353-8f54-4144-a30c-a0f31d8dfa68 could not be found. Jun 16 15:15:32.703920 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': 'd3e4e353-8f54-4144-a30c-a0f31d8dfa68'} Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3e4e353-8f54-4144-a30c-a0f31d8dfa68 could not be found. Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:15:32.704952 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:15:32.707143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:15:32.707143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:15:32.707143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:15:32.707143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:15:32.707143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:15:32.707143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:15:32.707143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:15:32.707143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3e4e353-8f54-4144-a30c-a0f31d8dfa68 could not be found. Jun 16 15:15:32.707143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:15:32.707143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:15:32.707143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:15:32.707143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:15:32.707143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:15:32.707143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:15:32.707143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:15:32.707143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:15:32.707143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3e4e353-8f54-4144-a30c-a0f31d8dfa68 could not be found. Jun 16 15:15:32.707143 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:15:32.708630 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-9a8fd8e4-d4a0-4177-ae33-ae31dd67a45c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Returning 404 to user: Instance d3e4e353-8f54-4144-a30c-a0f31d8dfa68 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:15:32.708630 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-9a8fd8e4-d4a0-4177-ae33-ae31dd67a45c tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68" status: 404 len: 111 microversion: 2.1 time: 0.028838 Jun 16 15:15:32.708630 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 612/1221] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:15:32 2022] GET /compute/v2.1/servers/d3e4e353-8f54-4144-a30c-a0f31d8dfa68 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:15:35.745303 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-864435aa-1f07-4fce-95be-d95f6962fd28 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:15:35.745814 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-864435aa-1f07-4fce-95be-d95f6962fd28 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:15:35.747244 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-ce99d327-573c-4a20-a35c-b55db21c1563 req-fe9d70c6-b686-4b83-aee4-cb889ddaf9fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f06ba9-bccb-4e42-a282-fc1e5eba46b7", "tag": "d76982de-8b32-44b6-858b-8f1bb582cdbe"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:15:35.752190 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-864435aa-1f07-4fce-95be-d95f6962fd28 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:35.752644 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-864435aa-1f07-4fce-95be-d95f6962fd28 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:35.753436 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-864435aa-1f07-4fce-95be-d95f6962fd28 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:35.753887 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-864435aa-1f07-4fce-95be-d95f6962fd28 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:35.756303 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-ce99d327-573c-4a20-a35c-b55db21c1563 req-fe9d70c6-b686-4b83-aee4-cb889ddaf9fc service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:35.756749 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-ce99d327-573c-4a20-a35c-b55db21c1563 req-fe9d70c6-b686-4b83-aee4-cb889ddaf9fc service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:35.767866 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-ce99d327-573c-4a20-a35c-b55db21c1563 req-fe9d70c6-b686-4b83-aee4-cb889ddaf9fc service nova] Creating event network-changed:d76982de-8b32-44b6-858b-8f1bb582cdbe for instance 47f06ba9-bccb-4e42-a282-fc1e5eba46b7 on hv-cinder-83716 Jun 16 15:15:35.773373 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-ce99d327-573c-4a20-a35c-b55db21c1563 req-fe9d70c6-b686-4b83-aee4-cb889ddaf9fc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029770 Jun 16 15:15:35.774587 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 613/1222] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:15:35.781675 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-864435aa-1f07-4fce-95be-d95f6962fd28 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:15:35.868314 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-864435aa-1f07-4fce-95be-d95f6962fd28 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "DELETE /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 204 len: 0 microversion: 2.1 time: 0.126671 Jun 16 15:15:35.878380 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-a52e5175-bec0-4b03-aef4-60c19b278be4 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:15:35.879075 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-a52e5175-bec0-4b03-aef4-60c19b278be4 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:15:35.881907 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 610/1223] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:15:35 2022] DELETE /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:15:35.885451 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a52e5175-bec0-4b03-aef4-60c19b278be4 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:35.885898 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a52e5175-bec0-4b03-aef4-60c19b278be4 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:35.886668 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a52e5175-bec0-4b03-aef4-60c19b278be4 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:35.887092 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-a52e5175-bec0-4b03-aef4-60c19b278be4 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:36.022983 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.policy [None req-a52e5175-bec0-4b03-aef4-60c19b278be4 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117443) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:15:36.030832 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-a52e5175-bec0-4b03-aef4-60c19b278be4 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 200 len: 1576 microversion: 2.1 time: 0.156653 Jun 16 15:15:36.031408 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 614/1224] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:15:35 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:15:37.049519 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-584b5302-16ba-4703-b5ef-2d9b1f2f4d3f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:15:37.050733 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-584b5302-16ba-4703-b5ef-2d9b1f2f4d3f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:15:37.057206 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-584b5302-16ba-4703-b5ef-2d9b1f2f4d3f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:37.057660 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-584b5302-16ba-4703-b5ef-2d9b1f2f4d3f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:37.058425 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-584b5302-16ba-4703-b5ef-2d9b1f2f4d3f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:37.058863 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-584b5302-16ba-4703-b5ef-2d9b1f2f4d3f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:37.202565 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-584b5302-16ba-4703-b5ef-2d9b1f2f4d3f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:15:37.209997 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-584b5302-16ba-4703-b5ef-2d9b1f2f4d3f tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 200 len: 1576 microversion: 2.1 time: 0.164844 Jun 16 15:15:37.210562 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 611/1225] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:15:37 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:15:38.052048 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [req-636b5c2d-5f4c-49c1-8b93-7da8c5d06c86 req-9ba30df5-602a-4f8c-815b-fe21ccef2d71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f06ba9-bccb-4e42-a282-fc1e5eba46b7", "name": "network-vif-deleted", "tag": "d76982de-8b32-44b6-858b-8f1bb582cdbe"}]} {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:15:38.061461 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-636b5c2d-5f4c-49c1-8b93-7da8c5d06c86 req-9ba30df5-602a-4f8c-815b-fe21ccef2d71 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:38.061902 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [req-636b5c2d-5f4c-49c1-8b93-7da8c5d06c86 req-9ba30df5-602a-4f8c-815b-fe21ccef2d71 service nova] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:38.073539 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.compute.server_external_events [req-636b5c2d-5f4c-49c1-8b93-7da8c5d06c86 req-9ba30df5-602a-4f8c-815b-fe21ccef2d71 service nova] Creating event network-vif-deleted:d76982de-8b32-44b6-858b-8f1bb582cdbe for instance 47f06ba9-bccb-4e42-a282-fc1e5eba46b7 on hv-cinder-83716 Jun 16 15:15:38.078499 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [req-636b5c2d-5f4c-49c1-8b93-7da8c5d06c86 req-9ba30df5-602a-4f8c-815b-fe21ccef2d71 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030153 Jun 16 15:15:38.079104 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 615/1226] 10.222.0.76 () {64 vars in 1317 bytes} [Thu Jun 16 15:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:15:38.227012 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8a1abe6c-1ae4-4929-9022-e6cca75e2490 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:15:38.227555 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8a1abe6c-1ae4-4929-9022-e6cca75e2490 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:15:38.234350 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8a1abe6c-1ae4-4929-9022-e6cca75e2490 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:38.234800 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8a1abe6c-1ae4-4929-9022-e6cca75e2490 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:38.235565 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8a1abe6c-1ae4-4929-9022-e6cca75e2490 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:38.236034 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8a1abe6c-1ae4-4929-9022-e6cca75e2490 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:38.299613 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8a1abe6c-1ae4-4929-9022-e6cca75e2490 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7a7cad42794792b05393a4b1582bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a575aa707340efb2cf89faf6a016bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:15:38.307124 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8a1abe6c-1ae4-4929-9022-e6cca75e2490 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 200 len: 1226 microversion: 2.1 time: 0.084048 Jun 16 15:15:38.307640 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 612/1227] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:15:38 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:15:39.324614 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7bdce0f6-3448-4324-a7bb-f6b862e24bf9 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:15:39.325225 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-7bdce0f6-3448-4324-a7bb-f6b862e24bf9 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: 47f06ba9-bccb-4e42-a282-fc1e5eba46b7] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:15:39.331964 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7bdce0f6-3448-4324-a7bb-f6b862e24bf9 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:39.332992 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7bdce0f6-3448-4324-a7bb-f6b862e24bf9 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:39.333739 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7bdce0f6-3448-4324-a7bb-f6b862e24bf9 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:39.334170 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-7bdce0f6-3448-4324-a7bb-f6b862e24bf9 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:39.347054 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-7bdce0f6-3448-4324-a7bb-f6b862e24bf9 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] HTTP exception thrown: Instance 47f06ba9-bccb-4e42-a282-fc1e5eba46b7 could not be found. Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7bdce0f6-3448-4324-a7bb-f6b862e24bf9 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Request method failure captured: Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 HTTP/1.1 Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0d-q-5-TL-9SZg9InSEub5tli6waA0S2qHpqkjykIPJSjA451tGqmuylDI0sgc8jnSzd69A-VfCZfJqElWuKS9QYsJqzsKQlVCjMfQimD9JJkV_rfvvKskdm9bpIYllf0zmJEwyR5d_mXNltggb-DsfFHwE1Ge45cw_SYhwy_z44sY Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 52a575aa707340efb2cf89faf6a016bc Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-TestVolumeBootPattern-1276089102 Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 15:15:39.349248 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 15:15:39.350959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:15:39.350959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-TestVolumeBootPattern-1276089102 Jun 16 15:15:39.350959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 52a575aa707340efb2cf89faf6a016bc Jun 16 15:15:39.350959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-TestVolumeBootPattern-1276089102 Jun 16 15:15:39.350959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-TestVolumeBootPattern-1276089102-project Jun 16 15:15:39.350959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 15:15:39.350959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 15:15:39.350959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: ee7a7cad42794792b05393a4b1582bc6 Jun 16 15:15:39.350959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-TestVolumeBootPattern-1276089102-project Jun 16 15:15:39.350959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 15:15:39.350959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance 47f06ba9-bccb-4e42-a282-fc1e5eba46b7 could not be found. Jun 16 15:15:39.350959 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': '47f06ba9-bccb-4e42-a282-fc1e5eba46b7'} Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47f06ba9-bccb-4e42-a282-fc1e5eba46b7 could not be found. Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:15:39.351974 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:15:39.353772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:15:39.353772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:15:39.353772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:15:39.353772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:15:39.353772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:15:39.353772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:15:39.353772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:15:39.353772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47f06ba9-bccb-4e42-a282-fc1e5eba46b7 could not be found. Jun 16 15:15:39.353772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:15:39.353772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:15:39.353772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:15:39.353772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:15:39.353772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:15:39.353772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:15:39.353772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:15:39.353772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:15:39.353772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47f06ba9-bccb-4e42-a282-fc1e5eba46b7 could not be found. Jun 16 15:15:39.353772 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:15:39.355275 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-7bdce0f6-3448-4324-a7bb-f6b862e24bf9 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Returning 404 to user: Instance 47f06ba9-bccb-4e42-a282-fc1e5eba46b7 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:15:39.355275 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-7bdce0f6-3448-4324-a7bb-f6b862e24bf9 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7" status: 404 len: 111 microversion: 2.1 time: 0.030567 Jun 16 15:15:39.355275 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 616/1228] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:15:39 2022] GET /compute/v2.1/servers/47f06ba9-bccb-4e42-a282-fc1e5eba46b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:15:40.032201 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e31f3aca-4f58-4786-9c08-85d6b7a309c0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:15:40.032781 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e31f3aca-4f58-4786-9c08-85d6b7a309c0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:15:40.039933 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e31f3aca-4f58-4786-9c08-85d6b7a309c0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:40.040382 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e31f3aca-4f58-4786-9c08-85d6b7a309c0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:40.041140 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e31f3aca-4f58-4786-9c08-85d6b7a309c0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:40.041580 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e31f3aca-4f58-4786-9c08-85d6b7a309c0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:40.054940 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-e31f3aca-4f58-4786-9c08-85d6b7a309c0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] HTTP exception thrown: Instance edd1b913-1070-4e9f-a177-05eeeb807618 could not be found. Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e31f3aca-4f58-4786-9c08-85d6b7a309c0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Request method failure captured: Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: request: DELETE /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 HTTP/1.1 Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept: application/json Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Connection: close Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Length: 0 Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Content-Type: application/json Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Host: 10.222.0.76 Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABiq0d-q-5-TL-9SZg9InSEub5tli6waA0S2qHpqkjykIPJSjA451tGqmuylDI0sgc8jnSzd69A-VfCZfJqElWuKS9QYsJqzsKQlVCjMfQimD9JJkV_rfvvKskdm9bpIYllf0zmJEwyR5d_mXNltggb-DsfFHwE1Ge45cw_SYhwy_z44sY Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Id: None Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Domain-Name: None Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Id: 52a575aa707340efb2cf89faf6a016bc Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-TestVolumeBootPattern-1276089102 Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Role: member,reader Jun 16 15:15:40.056600 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Roles: member,reader Jun 16 15:15:40.058388 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:15:40.058388 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-TestVolumeBootPattern-1276089102 Jun 16 15:15:40.058388 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 52a575aa707340efb2cf89faf6a016bc Jun 16 15:15:40.058388 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-TestVolumeBootPattern-1276089102 Jun 16 15:15:40.058388 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User: tempest-TestVolumeBootPattern-1276089102-project Jun 16 15:15:40.058388 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default Jun 16 15:15:40.058388 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default Jun 16 15:15:40.058388 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Id: ee7a7cad42794792b05393a4b1582bc6 Jun 16 15:15:40.058388 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-TestVolumeBootPattern-1276089102-project Jun 16 15:15:40.058388 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: method: > Jun 16 15:15:40.058388 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: exception: Instance edd1b913-1070-4e9f-a177-05eeeb807618 could not be found. Jun 16 15:15:40.058388 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: action_args: {'id': 'edd1b913-1070-4e9f-a177-05eeeb807618'} Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edd1b913-1070-4e9f-a177-05eeeb807618 could not be found. Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:15:40.059526 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edd1b913-1070-4e9f-a177-05eeeb807618 could not be found. Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edd1b913-1070-4e9f-a177-05eeeb807618 could not be found. Jun 16 15:15:40.061290 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Jun 16 15:15:40.063017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e31f3aca-4f58-4786-9c08-85d6b7a309c0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Returning 404 to user: Instance edd1b913-1070-4e9f-a177-05eeeb807618 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:15:40.063017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e31f3aca-4f58-4786-9c08-85d6b7a309c0 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "DELETE /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 404 len: 111 microversion: 2.1 time: 0.029684 Jun 16 15:15:40.063017 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 613/1229] 10.222.0.76 () {58 vars in 1238 bytes} [Thu Jun 16 15:15:40 2022] DELETE /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 15:15:40.066439 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-59fbe8bc-1d8e-4017-99e7-dcba4f767bb3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '>' {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:15:40.067095 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.compute.api [None req-59fbe8bc-1d8e-4017-99e7-dcba4f767bb3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] [instance: edd1b913-1070-4e9f-a177-05eeeb807618] Fetching instance by UUID {{(pid=117443) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:15:40.073058 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-59fbe8bc-1d8e-4017-99e7-dcba4f767bb3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:40.073508 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-59fbe8bc-1d8e-4017-99e7-dcba4f767bb3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:40.074287 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-59fbe8bc-1d8e-4017-99e7-dcba4f767bb3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:15:40.074849 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG oslo_concurrency.lockutils [None req-59fbe8bc-1d8e-4017-99e7-dcba4f767bb3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Lock "58914df1-3604-4005-8544-4e2578c5de60" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:15:40.088399 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.wsgi [None req-59fbe8bc-1d8e-4017-99e7-dcba4f767bb3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] HTTP exception thrown: Instance edd1b913-1070-4e9f-a177-05eeeb807618 could not be found. Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-59fbe8bc-1d8e-4017-99e7-dcba4f767bb3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Request method failure captured: Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: request: GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 HTTP/1.1 Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept: application/json Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Accept-Encoding: identity Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Connection: close Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Length: 0 Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Content-Type: application/json Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Host: 10.222.0.76 Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Openstack-System-Scope: None Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: User-Agent: python-urllib3/1.26.9 Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Auth-Token: gAAAAABiq0d-q-5-TL-9SZg9InSEub5tli6waA0S2qHpqkjykIPJSjA451tGqmuylDI0sgc8jnSzd69A-VfCZfJqElWuKS9QYsJqzsKQlVCjMfQimD9JJkV_rfvvKskdm9bpIYllf0zmJEwyR5d_mXNltggb-DsfFHwE1Ge45cw_SYhwy_z44sY Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Id: None Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Domain-Name: None Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Identity-Status: Confirmed Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Is-Admin-Project: True Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Id: default Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Domain-Name: Default Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Id: 52a575aa707340efb2cf89faf6a016bc Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Project-Name: tempest-TestVolumeBootPattern-1276089102 Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Role: member,reader Jun 16 15:15:40.089881 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Roles: member,reader Jun 16 15:15:40.091570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.76:8080", "publicURL": "http://10.222.0.76:8080/v1/AUTH_52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/52a575aa707340efb2cf89faf6a016bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}] Jun 16 15:15:40.091570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant: tempest-TestVolumeBootPattern-1276089102 Jun 16 15:15:40.091570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Id: 52a575aa707340efb2cf89faf6a016bc Jun 16 15:15:40.091570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-Tenant-Name: tempest-TestVolumeBootPattern-1276089102 Jun 16 15:15:40.091570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User: tempest-TestVolumeBootPattern-1276089102-project Jun 16 15:15:40.091570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Id: default Jun 16 15:15:40.091570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Domain-Name: Default Jun 16 15:15:40.091570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Id: ee7a7cad42794792b05393a4b1582bc6 Jun 16 15:15:40.091570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: X-User-Name: tempest-TestVolumeBootPattern-1276089102-project Jun 16 15:15:40.091570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: method: > Jun 16 15:15:40.091570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: exception: Instance edd1b913-1070-4e9f-a177-05eeeb807618 could not be found. Jun 16 15:15:40.091570 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: action_args: {'id': 'edd1b913-1070-4e9f-a177-05eeeb807618'} Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: {{(pid=117443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edd1b913-1070-4e9f-a177-05eeeb807618 could not be found. Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:15:40.092833 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:15:40.094895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:15:40.094895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:15:40.094895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:15:40.094895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:15:40.094895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:15:40.094895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:15:40.094895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:15:40.094895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edd1b913-1070-4e9f-a177-05eeeb807618 could not be found. Jun 16 15:15:40.094895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:15:40.094895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:15:40.094895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:15:40.094895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:15:40.094895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:15:40.094895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:15:40.094895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:15:40.094895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:15:40.094895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edd1b913-1070-4e9f-a177-05eeeb807618 could not be found. Jun 16 15:15:40.094895 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: ERROR nova.api.openstack.wsgi Jun 16 15:15:40.096408 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: DEBUG nova.api.openstack.wsgi [None req-59fbe8bc-1d8e-4017-99e7-dcba4f767bb3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Returning 404 to user: Instance edd1b913-1070-4e9f-a177-05eeeb807618 could not be found. {{(pid=117443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:15:40.096408 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO nova.api.openstack.requestlog [None req-59fbe8bc-1d8e-4017-99e7-dcba4f767bb3 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618" status: 404 len: 111 microversion: 2.1 time: 0.028638 Jun 16 15:15:40.096408 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: [pid: 117443|app: 0|req: 617/1230] 10.222.0.76 () {58 vars in 1235 bytes} [Thu Jun 16 15:15:40 2022] GET /compute/v2.1/servers/edd1b913-1070-4e9f-a177-05eeeb807618 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:15:41.376648 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-be28341c-4b89-42c0-b15a-3b2f7f846e00 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] Calling method '.version_select at 0x7f33e14af4c0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:15:41.401907 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-be28341c-4b89-42c0-b15a-3b2f7f846e00 tempest-TestVolumeBootPattern-1276089102 tempest-TestVolumeBootPattern-1276089102-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1475024670" status: 202 len: 0 microversion: 2.1 time: 0.029018 Jun 16 15:15:41.402439 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 614/1231] 10.222.0.76 () {58 vars in 1262 bytes} [Thu Jun 16 15:15:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1475024670 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:15:52.464392 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:15:52.464976 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Thu Jun 16 15:15:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:17:32.869716 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:17:32.870401 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Thu Jun 16 15:17:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:19:12.360057 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:19:12.360680 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Thu Jun 16 15:19:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:19:12.473064 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:19:12.473625 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Thu Jun 16 15:19:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:20:43.773534 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:20:43.774062 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Thu Jun 16 15:20:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:20:52.878325 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:20:52.878940 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Thu Jun 16 15:20:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:21:09.795314 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:21:09.795966 dv-cinder-837163-3-iscsi devstack@n-api.service[117444]: Thu Jun 16 15:21:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:21:11.916515 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:21:11.916933 dv-cinder-837163-3-iscsi devstack@n-api.service[117443]: Thu Jun 16 15:21:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!